-- Logs begin at Wed 2022-06-08 12:46:31 UTC, end at Wed 2022-06-08 14:12:15 UTC. -- Jun 08 13:25:55.396192 dv-cinder-819149-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 08 13:25:55.405745 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 13:25:55 2022] *** Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: nodename: dv-cinder-819149-5-iscsi Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: machine: x86_64 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: clock source: unix Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: pcre jit disabled Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: detected number of CPU cores: 4 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: current working directory: / Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: detected binary path: /usr/bin/uwsgi-core Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: your processes number limit is 47680 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: your memory page size is 4096 bytes Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: detected max file descriptor number: 2048 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: lock engine: pthread robust mutexes Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: thunder lock: enabled Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 08 13:25:55.417104 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 13:25:55.455080 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: Python main interpreter initialized at 0x560b8e6289c0 Jun 08 13:25:55.455080 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: python threads support enabled Jun 08 13:25:55.455080 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: your server socket listen backlog is limited to 100 connections Jun 08 13:25:55.455080 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: your mercy for graceful operations on workers is 90 seconds Jun 08 13:25:55.455394 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 13:25:55.455500 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: *** Operational MODE: preforking *** Jun 08 13:25:55.455773 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: *** uWSGI is running in multiple interpreter mode *** Jun 08 13:25:55.455773 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: spawned uWSGI master process (pid: 80566) Jun 08 13:25:55.455977 dv-cinder-819149-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 08 13:25:55.458216 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: spawned uWSGI worker 1 (pid: 80578, cores: 1) Jun 08 13:25:55.458216 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: spawned uWSGI worker 2 (pid: 80579, cores: 1) Jun 08 13:25:55.458216 dv-cinder-819149-5-iscsi devstack@keystone.service[80566]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 13:26:01.202892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:26:01.202892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: from cryptography.utils import int_from_bytes Jun 08 13:26:01.203663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:26:01.203663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: from cryptography.utils import int_from_bytes Jun 08 13:26:01.203796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:26:01.203796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: from cryptography.utils import int_from_bytes Jun 08 13:26:01.204278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:26:01.204278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: from cryptography.utils import int_from_bytes Jun 08 13:26:01.253917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 13:26:01.254075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 13:26:01.254156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 13:26:01.254234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 13:26:01.254305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] command line args: [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 13:26:01.254364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] command line args: [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 13:26:01.254552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 13:26:01.254642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 13:26:01.254715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ================================================================================ {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 13:26:01.254787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ================================================================================ {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 13:26:01.254970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] admin_token = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] admin_token = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] config_dir = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] config_dir = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] config_source = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] config_source = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] debug = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] debug = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.255943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.256982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_config_append = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_config_append = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_dir = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.257934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_dir = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_file = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_file = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.258976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.259939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.260883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.261990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] publish_errors = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] publish_errors = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.262972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] standard_threads = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] standard_threads = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.263979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] use_journal = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] use_journal = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] use_json = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] use_json = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] use_stderr = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] use_stderr = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] use_syslog = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.264872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] use_syslog = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.265019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.265094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:26:01.265274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.265356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.265510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.265588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.265767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.265843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.266968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.267940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.268935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.269998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.270919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271485 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.271931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.272901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.273890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.274953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.275727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.276935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277758 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.277988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.278935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.279881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.280995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.281968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.282931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.283963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.284948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.285909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.286859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.287934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.288981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.289982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.external = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.external = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.290986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.291112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.291198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.291852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.password = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.password = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] auth.token = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] auth.token = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.292915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.293853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.294981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.295809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.296256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.296344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.296498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.296576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.296750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.296830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.297871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.298842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.299987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.300971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.301934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.302013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.302169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.302258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.303917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.303998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.304987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.305964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.306807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.307528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.307612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.307898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.307978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.308930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.309909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.310881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.311867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.312985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.313949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.314976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.315920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.316899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.317866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.318948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.319931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.320974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.321928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.322985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.323971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.324946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.325918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.326876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] role.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] role.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] role.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] role.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.327985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.328863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.329969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.330941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.331895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.332899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.333859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.334969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.335977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.336966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.337930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.338878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339543 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.339855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.connection = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.connection = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340841 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.340923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.341865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.342970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.343926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.344974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:26:01.345065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 13:26:01.345151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 13:26:01.374737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.374978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.375204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.375498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.375734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.375959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.383560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.384317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.411464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.411691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.412337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.412574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.466060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.466535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.515180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.515407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.516147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.516391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.581621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.581844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.582924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.583146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.583364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.606681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.606891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.606985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.607980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.608131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.608349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.618773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.619067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.631558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.631792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.632995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.633108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.633324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 13:26:01.650131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.650342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 13:26:01.651069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.651201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.651397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 13:26:01.651480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 13:26:01.651718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.651908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.651999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.652142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 13:26:01.652249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.652416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.652497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.652678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.652933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.653188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.663212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.663492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.663764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.663961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.664234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.664319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.664523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.664970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.673251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.673959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.676530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.676814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.677095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.677270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.677364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.677552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.677634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.677916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.678921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.679055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.679185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.679312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.679453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.679698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.680076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.705467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.706588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.707067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.707349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.708241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.708523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.712729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.713011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.713803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.714583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.714867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.715147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.721215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.721502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.722453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.722740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.725965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.726256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.726537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.726819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.727095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.727221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.727370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.727497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.727744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.727869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.728014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.728160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.728325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.728603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.729644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.729924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.747285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.747558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.748715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.748994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.752267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.753742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.755900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.756229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.757429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.757733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.761492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.762811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.765133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.766438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.768752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.769052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.769337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.769628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.769922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.770093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.770319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.770454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.770661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.770958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.771240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.771643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.789684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.789967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.790235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.790498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.791090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.791435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.791710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.792005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.800367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.801770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.802184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.802464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.803582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.805536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.805820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.806099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.806379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.806664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.807959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.808281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.808567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.808863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.809144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.820504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.820787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.821067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.821353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.821633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.821906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.822190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.823360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.823648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.823931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.824240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.824521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.824797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.825070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.840689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.842934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.844120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.846371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.847425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.849067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.849730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.850698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.850980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.851268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.851396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.852997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.853278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.853580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.858779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.860492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.860927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.862666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.863719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.864006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.864308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.864581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.865915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.866209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.866494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.866784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.874245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.874534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.874816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.876478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.876771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.877054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.882782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.883062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.883342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.883618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.883887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.884183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.884457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.884732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.885571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.885719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 13:26:01.885860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.885990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.886238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.886365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.886519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.886647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.886783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.886910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.887046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.887172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.887299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.887566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.887833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.888142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.888425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.888704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.888976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.889242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 13:26:01.925153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b8e6289c0 pid: 80578 (default app) Jun 08 13:26:01.928424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e989-30be-4b68-af40-d6baa2363599 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:01.928527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b8e6289c0 pid: 80579 (default app) Jun 08 13:26:01.928717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e989-30be-4b68-af40-d6baa2363599 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:01.928992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e989-30be-4b68-af40-d6baa2363599 None None] PATH_INFO: `/v3` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:01.933871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Wed Jun 8 13:26:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:10.987221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:10.987824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:10.987824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:10.992150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:10.997300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:10.997704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:10.997849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:11.066030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: INFO dbcounter [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] Registered counter for database keystone Jun 08 13:26:11.087454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG oslo_db.sqlalchemy.engines [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:26:11.094430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writer thread running {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:26:11.374107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG passlib.handlers.bcrypt [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80578) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 13:26:11.374501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG passlib.handlers.bcrypt [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80578) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 13:26:11.429473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:11.431042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:11.554246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 558 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 13:26:11.723348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:11.793014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: INFO dbcounter [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] Registered counter for database keystone Jun 08 13:26:11.812839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG oslo_db.sqlalchemy.engines [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:26:11.819023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writer thread running {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:26:12.041879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064cfd5-ae8a-4170-a041-a5efbc8641f3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:12.046586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:12.047257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:12.047542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:12.047819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:12.056184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:12.107419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 13:26:12.107760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513f912-cc16-4561-9f3d-100fce011c1b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:12.117609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jun 8 13:26:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:26:12.124152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:12.138763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60856a7d-e988-43b7-849d-02456ae8b9db None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:12.143106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:12.144273 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:12.144554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:12.144825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] PATH_INFO: `/v3/projects/2c9b429555f24abe8bf7e676e75bbda4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:12.146329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] RBAC: Authorizing `identity:get_project(project_id=2c9b429555f24abe8bf7e676e75bbda4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:12.196431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 13:26:12.196766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e80fe9-9576-4571-b636-2a5948a3c73e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:12.203052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Wed Jun 8 13:26:12 2022] GET /identity/v3/projects/2c9b429555f24abe8bf7e676e75bbda4 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:14.396859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47313-1228-4dca-aff2-be73772bc6eb None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:14.397375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47313-1228-4dca-aff2-be73772bc6eb None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:14.397375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47313-1228-4dca-aff2-be73772bc6eb None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:14.402135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:14.407602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:14.408012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:14.408213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:14.427494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:14.429053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:14.437244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 13:26:14.459767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b47313-1228-4dca-aff2-be73772bc6eb None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:14.472522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b47313-1228-4dca-aff2-be73772bc6eb None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:14.476904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b766-5dd2-45f2-9e04-df04cbd67137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:14.477534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b766-5dd2-45f2-9e04-df04cbd67137 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:14.477816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b766-5dd2-45f2-9e04-df04cbd67137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:14.478092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b766-5dd2-45f2-9e04-df04cbd67137 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:14.486603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b766-5dd2-45f2-9e04-df04cbd67137 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:14.488394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b766-5dd2-45f2-9e04-df04cbd67137 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:14.497402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jun 8 13:26:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:26:14.502738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:14.511976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ee3a8-bada-41c2-81e6-061b5e7e94a1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:14.516413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1639-e023-494b-8047-4c93fdad7b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:14.517276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1639-e023-494b-8047-4c93fdad7b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:14.517562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1639-e023-494b-8047-4c93fdad7b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:14.517841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1639-e023-494b-8047-4c93fdad7b60 admin admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:14.519251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1639-e023-494b-8047-4c93fdad7b60 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:14.521123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1639-e023-494b-8047-4c93fdad7b60 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:14.522691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Wed Jun 8 13:26:14 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:16.832042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce8e41-64bc-48bf-a128-876853d2b5fe None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:16.832590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce8e41-64bc-48bf-a128-876853d2b5fe None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:16.832701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce8e41-64bc-48bf-a128-876853d2b5fe None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:16.833978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:16.840013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:16.840437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:16.840743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:16.851591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b47a5-adb4-4ca2-8271-bacf40e8898a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:16.851877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b47a5-adb4-4ca2-8271-bacf40e8898a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:16.852195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b47a5-adb4-4ca2-8271-bacf40e8898a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:16.854123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:16.858750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:16.859239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:16.859526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:16.859806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:16.859928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:16.901531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG passlib.handlers.bcrypt [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80579) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 13:26:16.901954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG passlib.handlers.bcrypt [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80579) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 13:26:16.941360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:16.949466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:16.951042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:16.965912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:16.990038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.052681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:17.070561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31324e-526f-4ae2-8071-5bf03b8aa4b8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.075463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.105916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.106723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.107009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.107282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.118145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:17.129411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:17.130417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:17.131243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:17.137112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.179215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a42e-6961-4a44-91bb-d45d4fb07dd8 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.181534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.216451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.217359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.217644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.217921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.218320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.236452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b81a-48a8-4428-b076-508a6aab7df5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.271027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.271700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.271985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.272295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.273045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:17.273352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.275541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.287030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.287156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:17.288733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.293489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.390215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 13:26:17.393950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65772ed-08df-4ae0-9203-bd372628f7ae None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.395732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.398418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.428576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.429467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.429755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.430032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.431320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.432825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.434481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:17.439787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.454505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.493792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a9d4-a18a-4dd6-a550-ac3c4b7f6b5c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.527858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.528693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.528976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.529259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.537483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66627326-ecb7-481e-884e-ce7d950eb23e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.548468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.549952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.570789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:26:17.571183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:17.572017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:17.573074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:26:17.573074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:26:17.573074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:26:17.573074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:17.573303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.573303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.573303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.573523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 9/18] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:17.574427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.575974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.582027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 10/19] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:17.582152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.582929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:17.639718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.665095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:17.679176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc9bc2-a17a-4c6e-b7e1-3e49638bf162 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.684480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6bf3f-94c7-4e47-9f24-032c573f88cb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:17.714176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.714846 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.715131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.715407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.716154 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:17.716459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.717842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2677c-fe0f-4caa-aba4-23f9eca6b42c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.718881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:17.719541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:17.719828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:17.720141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:17.721015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.domain.id=default, user.id=f3324493261445ea97cf7d9e4edb1c3a) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:17.721334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:17.722784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cc999-0ebb-4e45-8d45-495b029cd460 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:17.729539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/role_assignments?user.id=f3324493261445ea97cf7d9e4edb1c3a&scope.domain.id=default&role.id=06c074382d5e4a2893d59028af60fee8 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:17.735470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:20.269372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28bad-6343-42cc-a576-95be0349b323 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.269958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28bad-6343-42cc-a576-95be0349b323 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.269958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28bad-6343-42cc-a576-95be0349b323 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:20.271375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:20.277486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa408d-f1bf-4e96-975d-a6424c616504 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.277937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa408d-f1bf-4e96-975d-a6424c616504 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.278124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa408d-f1bf-4e96-975d-a6424c616504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:20.306586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-eefa408d-f1bf-4e96-975d-a6424c616504 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:20.308200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eefa408d-f1bf-4e96-975d-a6424c616504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:20.426569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:20.434474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e3417-999d-47e7-b6f4-2f018b42dbe4 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.434770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e3417-999d-47e7-b6f4-2f018b42dbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.435055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e3417-999d-47e7-b6f4-2f018b42dbe4 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:20.436443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:20.441707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.442008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.442289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:20.465628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e3417-999d-47e7-b6f4-2f018b42dbe4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:20.489488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:20.490701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:20.590335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:20.657872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 12/25] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:20.680841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e3417-999d-47e7-b6f4-2f018b42dbe4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:20.699339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:20.746624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:20.747571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.747922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.748279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:20.772177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:20.781143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:20.781998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:20.782744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:20.789418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 14/26] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:20.824873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:20.835390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:20.849794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b0746-f5e5-4939-8668-155c52c9b5ce None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:20.934298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e890-04f0-486b-85e7-060402123627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:20.935021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e890-04f0-486b-85e7-060402123627 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.935301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e890-04f0-486b-85e7-060402123627 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.935582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e890-04f0-486b-85e7-060402123627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:20.954506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e890-04f0-486b-85e7-060402123627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:20.956000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e890-04f0-486b-85e7-060402123627 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-a636e890-04f0-486b-85e7-060402123627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:26:20.993421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:20.994394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:20.995189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:26:20.995189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:26:20.995189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:26:20.995189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:20.995189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 13/27] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:20.998058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4b52-46f2-4cd9-ac00-5d5cf8b07482 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:20.998344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4b52-46f2-4cd9-ac00-5d5cf8b07482 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:20.998619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4b52-46f2-4cd9-ac00-5d5cf8b07482 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.002497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 14/28] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:21.004903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4b52-46f2-4cd9-ac00-5d5cf8b07482 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:21.038082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840a1aa-8c52-4f30-8181-6a6920da8511 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:21.078438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:21.080920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aba731-2123-473c-b278-87063ae4566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:21.081611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aba731-2123-473c-b278-87063ae4566e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.081892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aba731-2123-473c-b278-87063ae4566e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.082164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aba731-2123-473c-b278-87063ae4566e None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.082914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aba731-2123-473c-b278-87063ae4566e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:21.083215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aba731-2123-473c-b278-87063ae4566e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:21.084644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aba731-2123-473c-b278-87063ae4566e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:21.100391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 15/29] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:21.104610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.105544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.106017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.142462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:21.146332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:21.237066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4b52-46f2-4cd9-ac00-5d5cf8b07482 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:21.276433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:21.286716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 16/30] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:21.287793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:21.311221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:21.311902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.312211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.312490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.313225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:21.313534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:21.314931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdadac-4381-4bb2-a55a-e14703f34cb0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:21.328289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 15/31] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:21.329863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c420-1bc4-43b3-a405-c7922642bf4a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.330314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c420-1bc4-43b3-a405-c7922642bf4a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.330749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c420-1bc4-43b3-a405-c7922642bf4a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.332208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 16/32] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:21.333128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5c420-1bc4-43b3-a405-c7922642bf4a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:21.423468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0c565-3be5-4517-9511-56f9a301dc34 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:21.440975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:21.456220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5c420-1bc4-43b3-a405-c7922642bf4a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:21.461355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:21.461701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.462144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.462607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.463992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:21.465641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:21.467828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 17/33] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:21 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:21.468907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:21.496793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efba67a-2d41-412c-9a32-33d309594d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:21.497693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efba67a-2d41-412c-9a32-33d309594d78 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.498138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efba67a-2d41-412c-9a32-33d309594d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.498567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efba67a-2d41-412c-9a32-33d309594d78 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.499580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efba67a-2d41-412c-9a32-33d309594d78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:21.501301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efba67a-2d41-412c-9a32-33d309594d78 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:21.535874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:21.574639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7093194-85ca-4ddb-9d8f-ca9ef631e828 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:21.612472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43362d-bc9a-4ea2-9191-562138fa5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:21.613150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43362d-bc9a-4ea2-9191-562138fa5160 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.613492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43362d-bc9a-4ea2-9191-562138fa5160 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.613774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43362d-bc9a-4ea2-9191-562138fa5160 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.617526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43362d-bc9a-4ea2-9191-562138fa5160 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:21.617526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43362d-bc9a-4ea2-9191-562138fa5160 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:21.721730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 17/34] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 8 13:26:21 2022] POST /identity/v3/roles => generated 219 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:21.723497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.723794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.724146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.743786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:21.745457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:21.834198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 18/35] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:21.834198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:21.886330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 18/36] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:26:21 2022] POST /identity/v3/projects => generated 301 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:21.888392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ac82-a2bb-4c83-8abb-d1370a2c4a42 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:21.888919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ac82-a2bb-4c83-8abb-d1370a2c4a42 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:21.890525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ac82-a2bb-4c83-8abb-d1370a2c4a42 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:21.892813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 19/37] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:21.898496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ac82-a2bb-4c83-8abb-d1370a2c4a42 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:21.952357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:21.987588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b05ee-7277-4bd2-ba4c-6a48482a8c66 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:22.029229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfd6dd-79c1-4b48-bfb8-14d57488dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:22.030424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd6dd-79c1-4b48-bfb8-14d57488dbcd None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.030935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd6dd-79c1-4b48-bfb8-14d57488dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.031430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd6dd-79c1-4b48-bfb8-14d57488dbcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.033332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd6dd-79c1-4b48-bfb8-14d57488dbcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:22.035253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd6dd-79c1-4b48-bfb8-14d57488dbcd None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:22.037626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:22.039227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.040869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.041381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.060840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ac82-a2bb-4c83-8abb-d1370a2c4a42 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:22.062375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:22.063960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:22.083184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:22.120094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfd3bc-2d06-40dd-be44-75a1e8032fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:22.121028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfd3bc-2d06-40dd-be44-75a1e8032fdf None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.121445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfd3bc-2d06-40dd-be44-75a1e8032fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.121893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfd3bc-2d06-40dd-be44-75a1e8032fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.122896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfd3bc-2d06-40dd-be44-75a1e8032fdf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:22.124856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfd3bc-2d06-40dd-be44-75a1e8032fdf None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:22.158925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 20/39] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:22.159911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:22.194860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 8 13:26:21 2022] POST /identity/v3/roles => generated 225 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:22.197117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabad56-7238-49d9-bb47-ff7dec759c2f None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.197412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabad56-7238-49d9-bb47-ff7dec759c2f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.197746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabad56-7238-49d9-bb47-ff7dec759c2f None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.199249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 21/41] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:22.203802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabad56-7238-49d9-bb47-ff7dec759c2f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:22.256985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:22.283717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153d372-ed21-4f41-a100-2aa0ef1e0ae0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:22.326086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabad56-7238-49d9-bb47-ff7dec759c2f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:22.327504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9ebc7-3564-4e1a-bc3e-3ad7131f2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:22.328436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9ebc7-3564-4e1a-bc3e-3ad7131f2afb None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.328726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9ebc7-3564-4e1a-bc3e-3ad7131f2afb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.329013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9ebc7-3564-4e1a-bc3e-3ad7131f2afb None admin] PATH_INFO: `/v3/domains/default/users/f3324493261445ea97cf7d9e4edb1c3a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.331442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9ebc7-3564-4e1a-bc3e-3ad7131f2afb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f3324493261445ea97cf7d9e4edb1c3a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:22.332988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9ebc7-3564-4e1a-bc3e-3ad7131f2afb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:22.365674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:22.366281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.366569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.366847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.367612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:22.370027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:22.445417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 21/42] 10.222.0.55 () {58 vars in 1361 bytes} [Wed Jun 8 13:26:22 2022] PUT /identity/v3/domains/default/users/f3324493261445ea97cf7d9e4edb1c3a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:22.447519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.447820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.448131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.467031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:22.468317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:22.482012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 22/43] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 8 13:26:22 2022] POST /identity/v3/roles => generated 223 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:22.550935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 22/44] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:22.575872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:22.617891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:22.696155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc1fa-c11c-482b-8ceb-c9cea27fc919 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:22.731209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475facd1-3acf-45ef-8d78-6cb2437b393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:22.732421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475facd1-3acf-45ef-8d78-6cb2437b393e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.732708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475facd1-3acf-45ef-8d78-6cb2437b393e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.732986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475facd1-3acf-45ef-8d78-6cb2437b393e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.734287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475facd1-3acf-45ef-8d78-6cb2437b393e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:22.735759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475facd1-3acf-45ef-8d78-6cb2437b393e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:22.737445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 23/45] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:22.743578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:22.814914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:22.849736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6b0f-d3c4-47ec-afbe-c6844b4f6715 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:22.884312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16fe47-e69d-419f-9524-88d727e49805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:22.884913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16fe47-e69d-419f-9524-88d727e49805 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:22.885204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16fe47-e69d-419f-9524-88d727e49805 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:22.885485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16fe47-e69d-419f-9524-88d727e49805 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:22.886210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16fe47-e69d-419f-9524-88d727e49805 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:22.887670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16fe47-e69d-419f-9524-88d727e49805 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:22.970583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:26:22 2022] POST /identity/v3/projects => generated 312 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:26:24.716974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a692b-1360-44bf-a672-fac6760fb049 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:24.717531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a692b-1360-44bf-a672-fac6760fb049 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:24.717531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a692b-1360-44bf-a672-fac6760fb049 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:24.718889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 24/47] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:24.724084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:24.724475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:24.724671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:24.742006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:24.744026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:24.809532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 24/48] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:24.832196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a692b-1360-44bf-a672-fac6760fb049 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:24.938058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a692b-1360-44bf-a672-fac6760fb049 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:24.940392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:24.970961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:24.971691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:24.971977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:24.972279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:24.985590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:24.993772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:24.994647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:24.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 25/49] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:25.000805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:25.053232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:25.107871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d0938-70cb-491a-baac-48b3a902c5de None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:25.141163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:25.141830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.142116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.142393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.143142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:25.143451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:25.144875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3830bf-0d3d-4e8e-9304-65c084cae71d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:25.157910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 25/50] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:25.163180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:25.222947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa098a8-cc30-49b7-a76f-24331c99c6d2 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.223156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa098a8-cc30-49b7-a76f-24331c99c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.223458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa098a8-cc30-49b7-a76f-24331c99c6d2 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.224832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 26/51] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:25.229861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.230148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.230431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.246794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:25.247980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:25.265493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1167-aff9-4736-a765-e6382d631818 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:25.301031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:25.301924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.302211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.302491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.303679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:25.305342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:25.306978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 26/52] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:25 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:25.312455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:25.318018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 27/53] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:25.342220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:25.352837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:25.385515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:25.426797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386e17-c5e0-47c4-a1a8-b388365e602a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:25.442988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea85a0-8e76-4c78-bbde-85be1825f7e9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:25.461803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:25.462789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.463080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.463363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.464614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:25.466161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:25.467954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 27/54] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:25.473767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:25.478822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:25.479624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.479913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.480230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.481420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:25.482886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:25.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:25.489857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:25.570630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:25.573846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84fd3f-746c-4e78-83ac-3dffa309fa29 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:25.587901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77f642-c19c-440c-8c5f-37da445153a2 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:25.597981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:25.608437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:25.609094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.609379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.609659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.610486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.domain.id=default, user.id=f3324493261445ea97cf7d9e4edb1c3a) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:25.610833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:25.612305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436330b6-8e64-4455-95c0-900b828ded91 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:25.618678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 28/56] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jun 8 13:26:25 2022] GET /identity/v3/role_assignments?user.id=f3324493261445ea97cf7d9e4edb1c3a&scope.domain.id=default&role.id=06c074382d5e4a2893d59028af60fee8 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:25.622471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c54c1-9611-4e19-b0ca-ca6c78f82aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:25.623208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c54c1-9611-4e19-b0ca-ca6c78f82aed None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:25.623503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c54c1-9611-4e19-b0ca-ca6c78f82aed None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:25.623784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c54c1-9611-4e19-b0ca-ca6c78f82aed None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:25.624552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c54c1-9611-4e19-b0ca-ca6c78f82aed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:25.626046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c54c1-9611-4e19-b0ca-ca6c78f82aed None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:25.738052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 29/57] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jun 8 13:26:25 2022] POST /identity/v3/projects => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:26:27.967852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e8e4-887d-4fea-a9f8-87e598d5d5ad None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:27.968407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e8e4-887d-4fea-a9f8-87e598d5d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:27.968497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e8e4-887d-4fea-a9f8-87e598d5d5ad None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:27.969832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 29/58] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:27.974942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:27.975360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:27.975517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:27.992811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:27.994016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:28.059323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:28.083660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e8e4-887d-4fea-a9f8-87e598d5d5ad None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:28.183006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e8e4-887d-4fea-a9f8-87e598d5d5ad None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:28.221769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541abdca-98a7-44cb-928c-5c258a079d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:28.222487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541abdca-98a7-44cb-928c-5c258a079d4c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:28.222771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541abdca-98a7-44cb-928c-5c258a079d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:28.223049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541abdca-98a7-44cb-928c-5c258a079d4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:28.224343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541abdca-98a7-44cb-928c-5c258a079d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:28.225796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541abdca-98a7-44cb-928c-5c258a079d4c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:28.228424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 30/60] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:28.233975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:28.321219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:28.330283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aa50d-b909-4d38-b7ed-de6724be8f75 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:28.363186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e99f7f-72a2-4cf1-b5ea-45f3e0781eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:28.363850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99f7f-72a2-4cf1-b5ea-45f3e0781eb1 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:28.364165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99f7f-72a2-4cf1-b5ea-45f3e0781eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:28.364447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99f7f-72a2-4cf1-b5ea-45f3e0781eb1 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:28.365168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99f7f-72a2-4cf1-b5ea-45f3e0781eb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:28.366612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99f7f-72a2-4cf1-b5ea-45f3e0781eb1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:28.461121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 31/61] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:26:28 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:31.716694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e413-45d9-4e7d-be1a-d244540c9d26 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:31.717213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e413-45d9-4e7d-be1a-d244540c9d26 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:31.717285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e413-45d9-4e7d-be1a-d244540c9d26 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:31.718928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 31/62] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:31.724756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc8d9-fa56-4ec1-bdb4-7a0e52b4867e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:31.725201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc8d9-fa56-4ec1-bdb4-7a0e52b4867e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:31.725363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc8d9-fa56-4ec1-bdb4-7a0e52b4867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:31.752693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b1acc8d9-fa56-4ec1-bdb4-7a0e52b4867e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:31.753940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b1acc8d9-fa56-4ec1-bdb4-7a0e52b4867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:31.858491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 32/63] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:31.891271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e413-45d9-4e7d-be1a-d244540c9d26 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:31.930637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a57a-a7d4-443d-b90e-4b31f09a7a1c None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:31.931204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a57a-a7d4-443d-b90e-4b31f09a7a1c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:31.931687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a57a-a7d4-443d-b90e-4b31f09a7a1c None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:31.933256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 33/64] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:31.935315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:31.939346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:31.939999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:31.940474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:31.966584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:31.969558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:32.057312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e413-45d9-4e7d-be1a-d244540c9d26 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.096938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 34/65] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:32.101567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.102665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.103158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.103623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.122146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.129009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:32.141174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:32.142052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:32.142798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 32/66] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:32.143407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.152297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.256182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26eb8c-c5c7-460f-928b-7eae30b0ab0a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.262688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.271549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339491-c31c-4ccb-b755-3efafe15af52 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.297176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.298230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.298659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.299112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.308992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.310001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.310525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.310992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.312018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:32.312536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:32.313393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:32.314343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acb0f6-3f2b-4f04-a16d-e3c329df3b2f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:32.323417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 33/67] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:32.323761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:32.324580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:32.325328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 35/68] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:32.327700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c496ac-703d-4d80-af2d-9f7c9bca2098 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.327992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c496ac-703d-4d80-af2d-9f7c9bca2098 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.328531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c496ac-703d-4d80-af2d-9f7c9bca2098 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.329173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.330217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 34/69] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:32.331038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c496ac-703d-4d80-af2d-9f7c9bca2098 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.410888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.444979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c496ac-703d-4d80-af2d-9f7c9bca2098 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.452437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd698e-3744-42bd-8dc1-d3e293939a58 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.484846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.485831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.486286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.486732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.487666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:32.488182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:32.489435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c62b2-1ef2-4bfa-84fa-e96c816573e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.489907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24365-2387-4e5a-8f91-76e9f86bdcf6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:32.490318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c62b2-1ef2-4bfa-84fa-e96c816573e8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.490605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c62b2-1ef2-4bfa-84fa-e96c816573e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.490883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c62b2-1ef2-4bfa-84fa-e96c816573e8 None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.498960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 35/70] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:32.500422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.500861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.501278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.508242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c62b2-1ef2-4bfa-84fa-e96c816573e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:32.509669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c62b2-1ef2-4bfa-84fa-e96c816573e8 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:32.511412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:32.512696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c38f-dbf3-44c5-91f3-5623d858a5fa None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.513149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c38f-dbf3-44c5-91f3-5623d858a5fa None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.513554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c38f-dbf3-44c5-91f3-5623d858a5fa None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.515157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 37/72] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:32.515981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c38f-dbf3-44c5-91f3-5623d858a5fa None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.524119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:32.525819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:32.538264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.601465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 36/73] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:32.603117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.624709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c38f-dbf3-44c5-91f3-5623d858a5fa None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.649489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.661142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35642-fef6-43f6-8b81-b4a9be55000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.662595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35642-fef6-43f6-8b81-b4a9be55000c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.662881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35642-fef6-43f6-8b81-b4a9be55000c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.663158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35642-fef6-43f6-8b81-b4a9be55000c None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.665461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35642-fef6-43f6-8b81-b4a9be55000c None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:32.667759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35642-fef6-43f6-8b81-b4a9be55000c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:32.670072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 38/74] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:32.671243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.671530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.671839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.689965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:32.691148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:32.725333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730ab5-7c7a-44b3-a5c3-c9aca80c33d0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.758982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 39/75] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:32.759578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986b889-2422-44b9-a27b-4c583ce9d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.760267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b889-2422-44b9-a27b-4c583ce9d985 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.760497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.760592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b889-2422-44b9-a27b-4c583ce9d985 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.760828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b889-2422-44b9-a27b-4c583ce9d985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.781045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.833282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986b889-2422-44b9-a27b-4c583ce9d985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:32.834766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986b889-2422-44b9-a27b-4c583ce9d985 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:32.867269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420de4d-a5d3-4122-a5cf-87bad51135d3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:32.889944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:32.901968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:32.902769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.903054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.903334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.913482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:32.921820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:32.922864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:32.923839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:32.926070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 40/76] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:32.926875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.937448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 37/77] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:32.938771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b0c5-2d15-412f-8ae9-8ce3be12a34f None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:32.939062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b0c5-2d15-412f-8ae9-8ce3be12a34f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:32.939341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b0c5-2d15-412f-8ae9-8ce3be12a34f None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:32.944336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 38/78] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:32.944336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b0c5-2d15-412f-8ae9-8ce3be12a34f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:32.988216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.028746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ba17-15da-46a5-9127-0ad04a06a01e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.040909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b0c5-2d15-412f-8ae9-8ce3be12a34f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.061753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.062402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.062686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.062962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.076096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.076902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.077182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.077453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.089258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:33.097055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:33.097914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:33.098671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 39/79] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:33.099379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.113452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.131790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.133864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.202659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40936a-6ddb-4aa1-9830-98dd2c4bdffc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.210808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.232200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 41/80] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:33.233043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.240733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.242068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.242470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.242751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.243498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:33.243806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.245230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceb58d-5f50-4e2a-bfaa-3f309f24cd4c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.253951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 40/81] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.255161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.255451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.255731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.272927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:33.274738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:33.315819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.334280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fcebc-2531-4fcd-856d-565cc8d466f9 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.341595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 41/82] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:33.342426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.370003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.370874 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.371160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.371433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.372671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.374100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.375956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 42/83] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.376582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.449541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.453319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dd611-27dd-497a-9056-531a914a1e63 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.477124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885e1ca-3768-47ef-a88c-be50bcf9b999 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.486048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.486991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.487463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.488076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.488835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:33.489148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.490565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.503038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 42/84] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.503038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.513404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.514555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.514836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.515110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.516312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.517747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.519421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 43/85] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.520195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.538652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.607554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe349-1641-4931-985b-8b82edd9431c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.617156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05ae16-4833-4b5f-99de-78a19a34a4c8 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.640453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.641324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.641608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.641886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.643085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.644593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.646225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 43/86] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.650892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.653975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.654771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.655050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.655322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.656529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.657972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.659582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 44/87] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.660359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.679378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.745082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.752776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024ac1a-aee1-40e8-9e70-f04ccf89be35 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.759658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67424-a505-4fda-8d5f-af33d20e0210 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.785286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.785950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.786237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.786515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.787344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=d79d89fc90a74e709dc9387801d50cf4) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:33.787656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.789935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.794292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.795158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.795436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.795707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.795903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 44/88] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/role_assignments?user.id=d79d89fc90a74e709dc9387801d50cf4&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=b6aee05490564ee3847a4e359279b54f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.796742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.797076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.798537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.800401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 45/89] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.801253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:33.917132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:33.924714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0640c46-4c7c-4141-8a09-0bcd547dc81b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.926067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09d22-9c37-49c5-9740-f4de4fe18239 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:33.963860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.964575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.964871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.965154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.965457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:33.966007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] RBAC: Adding query filter params (role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=d79d89fc90a74e709dc9387801d50cf4) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:33.966102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:33.966324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:33.966414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:33.966654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:33.967921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:33.984248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 45/90] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/role_assignments?user.id=d79d89fc90a74e709dc9387801d50cf4&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:33.984248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:34.020478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:34.064565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:34.066142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:34.127349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673a974-398d-4af9-949f-7d253be4b58f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:34.167722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:34.168814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:34.169195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:34.169580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:34.170421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:34.172029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:34.196471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 46/91] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:34.197732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:34.260171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 46/92] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:26:33 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:34.261509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:34.269805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:34.296476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:34.368508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d800bf9-86b7-48a1-92d4-f0afc5594b91 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:34.403499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8895c-fddc-4a0c-b3ec-665236604cf2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:34.433053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:34.433758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:34.433943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:34.434224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:34.442035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:34.448292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:34.448292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:34.448292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:34.448292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:34.448292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:34.448292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 47/93] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:34 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:34.455193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:34.566327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:34.567840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:34.570765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:34.594830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6d3ed-e31e-492c-bf2b-f188c3cfb71c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:34.638966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:34.639937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:34.640952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:34.641089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:34.641190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:34.641771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=f3324493261445ea97cf7d9e4edb1c3a) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:34.642088 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:34.643575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:34.651242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 48/94] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:34 2022] GET /identity/v3/role_assignments?user.id=f3324493261445ea97cf7d9e4edb1c3a&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:34.700264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 47/95] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:34.706005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:34.830803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460f7a8-71c2-4f20-a24e-0551f3a114e0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:34.872797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c26897-073b-45a5-b026-584687d15451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:34.873677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c26897-073b-45a5-b026-584687d15451 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:34.873960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c26897-073b-45a5-b026-584687d15451 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:34.874234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c26897-073b-45a5-b026-584687d15451 None admin] PATH_INFO: `/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:34.875656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c26897-073b-45a5-b026-584687d15451 None admin] RBAC: Authorizing `identity:get_project(project_id=a314eb5ad1724d1ba6b9dfad1c4d86d2)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:34.876938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c26897-073b-45a5-b026-584687d15451 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:34.878954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 49/96] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:34 2022] GET /identity/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:34.887785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:35.031322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183854f7-dd6c-4d19-9a55-cc6cae692fec None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:35.074305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:35.074974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:35.075257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:35.075538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:35.076406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=a314eb5ad1724d1ba6b9dfad1c4d86d2, user.id=d79d89fc90a74e709dc9387801d50cf4) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:35.076721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:35.078145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98f78-c75b-4506-9519-ca852598a1fa None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:35.086590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 48/97] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:34 2022] GET /identity/v3/role_assignments?user.id=d79d89fc90a74e709dc9387801d50cf4&scope.project.id=a314eb5ad1724d1ba6b9dfad1c4d86d2&role.id=b6aee05490564ee3847a4e359279b54f => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:36.504755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9589d-8dda-46eb-a56b-7ac050994a1c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:36.505743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9589d-8dda-46eb-a56b-7ac050994a1c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:36.506242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9589d-8dda-46eb-a56b-7ac050994a1c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:36.508398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 50/98] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:36.513702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4131-894b-425c-a843-60fe2d30fa4a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:36.514148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4131-894b-425c-a843-60fe2d30fa4a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:36.514319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4131-894b-425c-a843-60fe2d30fa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:36.536235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-132c4131-894b-425c-a843-60fe2d30fa4a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:36.537436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-132c4131-894b-425c-a843-60fe2d30fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:36.558227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:36.633215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 49/99] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:36.668886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9589d-8dda-46eb-a56b-7ac050994a1c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:36.687318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:36.808292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9589d-8dda-46eb-a56b-7ac050994a1c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:36.854384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:36.855195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:36.855480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:36.855753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:36.865313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2285f74-8a74-4e38-a017-e89a86e34528 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:36.865675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2285f74-8a74-4e38-a017-e89a86e34528 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:36.866894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2285f74-8a74-4e38-a017-e89a86e34528 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:36.868485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 50/100] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:36.871674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:36.877409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:36.877708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:36.877992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:36.879685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:36.880587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:36.881481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 51/101] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:36.887994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:36.916180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:36.917374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:37.022808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:37.087470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848413-af37-450c-b950-ebfe60dd3d48 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.099877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 51/102] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:37.143389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.166121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:37.166804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:37.167091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:37.167370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:37.168411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:37.168771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:37.170216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:37.185209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 52/103] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:37.190943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.338554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:37.343053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d99e-a664-441a-9b95-919b141b440b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.396786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:37.399191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:37.399480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:37.399762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:37.400459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647b03-82d1-4080-b1ff-6e133c5a96c4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.405846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:37.410365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:37.412107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 53/104] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:37 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:37.421007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.424923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:37.468920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:37.469818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:37.470106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:37.470374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:37.481116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:37.489338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:37.490347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:37.491419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 52/105] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:26:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:37.496265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.599912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b8e5d-0706-4e01-ab0d-5a49c07a120c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.636591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:37.637587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:37.637876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:37.638152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:37.638901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:37.639206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:37.640612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:37.646443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:37.651577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 53/106] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:26:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:37.655078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca428d-dd9a-4915-9992-97886455dbd8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.657227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.742764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:37.743672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:37.743955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:37.744289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:37.745617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:37.747155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:37.749015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 54/107] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:37 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:37.755072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.785213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c21069-1a9c-421a-aefc-dcecf6b70928 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.828006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:37.828914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:37.829200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:37.829475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:37.832701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:37.834152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:37.836299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 54/108] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:37 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:37.861641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:37.894905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:37.940196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:37.954236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d39c-1a8d-4137-825b-22f70d349efe None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:37.978059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969516-6ffe-42b2-94ba-34216968b2ed None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:38.015988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:38.017163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.017447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.017724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.018931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:38.020425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:38.023040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 55/109] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:37 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:38.028351 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:38.047202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d093-2bbd-4547-9e32-463eba797b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:38.048206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d093-2bbd-4547-9e32-463eba797b83 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.048496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d093-2bbd-4547-9e32-463eba797b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.048775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d093-2bbd-4547-9e32-463eba797b83 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5/users/d79d89fc90a74e709dc9387801d50cf4/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.055516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d093-2bbd-4547-9e32-463eba797b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e75612da3942be997ad038eadd12c5, user_id=d79d89fc90a74e709dc9387801d50cf4, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:38.057116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d093-2bbd-4547-9e32-463eba797b83 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:38.161356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 55/110] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:37 2022] PUT /identity/v3/projects/c7e75612da3942be997ad038eadd12c5/users/d79d89fc90a74e709dc9387801d50cf4/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:26:38.163297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdb2d-2356-4797-88ff-245dc76acb57 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.163591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdb2d-2356-4797-88ff-245dc76acb57 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.163867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdb2d-2356-4797-88ff-245dc76acb57 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.164864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb83d-cf7e-4996-95dc-064373572349 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:38.170545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 56/111] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:38.176264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb030-d44b-4e92-ab70-8334100d2c8f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.176560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb030-d44b-4e92-ab70-8334100d2c8f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.176906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb030-d44b-4e92-ab70-8334100d2c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.214446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-b56fb030-d44b-4e92-ab70-8334100d2c8f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:38.215767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b56fb030-d44b-4e92-ab70-8334100d2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:38.218823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:38.219780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.220078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.220374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5/users/d79d89fc90a74e709dc9387801d50cf4/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.227760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e75612da3942be997ad038eadd12c5, user_id=d79d89fc90a74e709dc9387801d50cf4, role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:38.229271 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:38.236212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:38.324685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 57/112] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:38.326086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067bc6b-3b31-4890-a590-b7c705ac44ca None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.326428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067bc6b-3b31-4890-a590-b7c705ac44ca None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.326711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067bc6b-3b31-4890-a590-b7c705ac44ca None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.328938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 58/113] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:38.335910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476befe2-58bb-406e-b895-dbaa6a04190a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.336350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476befe2-58bb-406e-b895-dbaa6a04190a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.336638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476befe2-58bb-406e-b895-dbaa6a04190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.356122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-476befe2-58bb-406e-b895-dbaa6a04190a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:38.357443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-476befe2-58bb-406e-b895-dbaa6a04190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:38.384993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 56/114] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:38 2022] PUT /identity/v3/projects/c7e75612da3942be997ad038eadd12c5/users/d79d89fc90a74e709dc9387801d50cf4/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:38.385849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:38.477666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:38.500764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 59/115] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:38.502571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ad9d-1574-4755-8f4c-5cb36cc793bd None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.504367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ad9d-1574-4755-8f4c-5cb36cc793bd None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.505060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ad9d-1574-4755-8f4c-5cb36cc793bd None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.513090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 60/116] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:38.514843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.516264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.517528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.547694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:38.549096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:38.591880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace1dd-552f-4286-a51b-b20a21a88f9a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:38.631768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:38.632619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.632953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.633291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.651018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 61/117] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:38.652666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:38.655792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:38.664675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:38.665559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:38.666306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 57/118] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:38.673457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:38.778200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:38.822535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649dc78-a145-4c24-a6a4-04ecdea5a4bc None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:38.848031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:38.850930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f7060-d4a5-45df-976e-989c258e6cc5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:38.864814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:38.866439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.866804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.867087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.879736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:38.889564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:38.890635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:38.891425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:38.892003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:38.892117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 62/119] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:38.892194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.892194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.892309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:38.892371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.892873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:38.893074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:38.895675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970817ca-6c5e-42b7-8edf-f0779f1ab726 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:38.905120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 58/120] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:38.908134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab55cc-cca2-4720-b863-49965bb129e1 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:38.908475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab55cc-cca2-4720-b863-49965bb129e1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:38.908822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab55cc-cca2-4720-b863-49965bb129e1 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:38.910173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 59/121] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:38.910890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab55cc-cca2-4720-b863-49965bb129e1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.025331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7efc8-575c-4099-8537-d94220bd7f7b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.040514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab55cc-cca2-4720-b863-49965bb129e1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.062668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:39.066205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.067019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.067408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.067700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.069575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.071262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.073181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 63/122] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:39.078598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.081813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.082489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.082774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.083047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.083795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:39.084124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.086800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce65e98-0c15-4280-99a8-cb21546ede9b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.100069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 60/123] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:39.100069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.100069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.100069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.120710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:39.122546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:39.153132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:39.218966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf56981-1741-4a87-9762-651f52fb7e51 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.219932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 61/124] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:39.221105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.269771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.272289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.272571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.272849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] PATH_INFO: `/v3/users/e7e53914fdb04c65961b48d4a54b5a8c` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.290886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e53914fdb04c65961b48d4a54b5a8c)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.292397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.296195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 64/125] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:39 2022] GET /identity/v3/users/e7e53914fdb04c65961b48d4a54b5a8c => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:39.297262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.361168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4699-e221-450d-ac71-c0365de1a652 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.376284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:39.407801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.408613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.408902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.409180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.409285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc264e-ff74-4de5-b946-6c80b9c89569 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.409886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.411603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.418946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:39.449395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.450509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.451008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.451458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.452864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.454475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.456299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 65/126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:39 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:39.457499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.551232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 62/127] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:26:39 2022] POST /identity/v3/projects => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:39.552321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.579906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e9a5-bbc6-4fc3-b7f7-e9dabd3cba73 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.627792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.629059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.629545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.630024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.646062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:39.655925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:39.656916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:39.657701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:39.660642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 66/128] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:39.661842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:39.744381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcff7b-1fb0-43c2-a0a9-cbc56400304d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.747273 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:39.796552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.797602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.798504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.799016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.840467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:39.870746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87805165-0a23-413a-a3f6-d04ec57a931e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:39.891804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.894097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.912167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:39.914040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:39.915314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:39.915660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:39.918168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:39.919826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:39.922054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 67/129] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:39 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:39.922908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:40.040970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 63/130] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:40.041635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:40.052045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379443-e122-4a8d-8711-baa51fac2184 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:40.054842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:40.122434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:40.123157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:40.123441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:40.123712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:40.124489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:40.124795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:40.126191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:40.145763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 68/131] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:40.146691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:40.173741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:40.235327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910bd3f-7dc4-4fb4-bac7-41f3caf116ed None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:40.305378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:40.306279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:40.306559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:40.306833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5/users/f3324493261445ea97cf7d9e4edb1c3a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:40.310414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e75612da3942be997ad038eadd12c5, user_id=f3324493261445ea97cf7d9e4edb1c3a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:40.311856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:40.335125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18d28a-16af-4944-987f-564e1524e2ae None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:40.371924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:40.372835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:40.373173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:40.373459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:40.374715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:40.376362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:40.378542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 69/132] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:40 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:40.379397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:40.389935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 64/133] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:40 2022] PUT /identity/v3/projects/c7e75612da3942be997ad038eadd12c5/users/f3324493261445ea97cf7d9e4edb1c3a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:40.390776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:40.440337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:40.537694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ce9e-1476-4511-abbb-08f8bb480031 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:40.592477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:40.608530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:40.609507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:40.609806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:40.610096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:40.610972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] RBAC: Adding query filter params (role.id=647e539bfe0f42ad9807d586f74cffe6, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=e7e53914fdb04c65961b48d4a54b5a8c) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:40.611293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:40.612845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:40.614056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce08a-dfb8-4df9-a551-350d5a7e86b4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:40.621055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 65/134] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:40 2022] GET /identity/v3/role_assignments?user.id=e7e53914fdb04c65961b48d4a54b5a8c&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=647e539bfe0f42ad9807d586f74cffe6 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:40.678970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:40.679790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:40.680086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:40.680364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:40.684974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:40.686563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:40.688397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 70/135] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:40 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:40.694378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:40.843558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c4b67-a8ba-44c8-a733-df01b9a2673b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:40.898879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952b35-2e23-43d5-890f-f5116dbc5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:40.899777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952b35-2e23-43d5-890f-f5116dbc5c77 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:40.900086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952b35-2e23-43d5-890f-f5116dbc5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:40.900360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952b35-2e23-43d5-890f-f5116dbc5c77 None admin] PATH_INFO: `/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:40.901578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952b35-2e23-43d5-890f-f5116dbc5c77 None admin] RBAC: Authorizing `identity:get_project(project_id=a314eb5ad1724d1ba6b9dfad1c4d86d2)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:40.903044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952b35-2e23-43d5-890f-f5116dbc5c77 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:40.904941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 66/136] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:40 2022] GET /identity/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:40.911059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.031801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:41.039410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e316b6c-9789-415d-af93-068a3cec1f04 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:41.086453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763856e-6e77-4d5d-bdf3-5ac7bd5cb02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:41.086903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763856e-6e77-4d5d-bdf3-5ac7bd5cb02c None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.087186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763856e-6e77-4d5d-bdf3-5ac7bd5cb02c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.087461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763856e-6e77-4d5d-bdf3-5ac7bd5cb02c None admin] PATH_INFO: `/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2/users/d79d89fc90a74e709dc9387801d50cf4/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.092949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763856e-6e77-4d5d-bdf3-5ac7bd5cb02c None admin] RBAC: Authorizing `identity:create_grant(project_id=a314eb5ad1724d1ba6b9dfad1c4d86d2, user_id=d79d89fc90a74e709dc9387801d50cf4, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:41.094433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763856e-6e77-4d5d-bdf3-5ac7bd5cb02c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:41.175492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7521d-c622-4cf7-97cd-36faedb607c4 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.175799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7521d-c622-4cf7-97cd-36faedb607c4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.176071 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7521d-c622-4cf7-97cd-36faedb607c4 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.177764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 67/137] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:41.183073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.183367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.183649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.207153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 71/138] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:40 2022] PUT /identity/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2/users/d79d89fc90a74e709dc9387801d50cf4/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:41.215774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:41.217873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd8ce-0402-46cb-b9fe-698f3465a487 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.218151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd8ce-0402-46cb-b9fe-698f3465a487 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.218425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd8ce-0402-46cb-b9fe-698f3465a487 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.219982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 72/139] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:41.221337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:41.232785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.233066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.233339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.259403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:41.261654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:41.321909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:41.356090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 68/140] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:41.374516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 73/141] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:41.398555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.399997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.558608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:41.568942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fccbad-43df-4ba4-b65c-1d46d2be2635 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:41.608937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:41.609880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.610227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.610567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.620198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161365b-f89d-4334-b6f8-4c07117a21c3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:41.622168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:41.630297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:41.632276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:41.633048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 74/142] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:41.638211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.685826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:41.686768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.687060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.687339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.712984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:41.721470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:41.723819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:41.726548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 69/143] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:41.732209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.749119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e48d-0889-4a4d-8e10-06fbd09254f3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:41.785139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:41.785814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.786100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.786479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.787805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:41.788140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:41.789531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:41.798562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 75/144] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:41.804831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.823522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:41.844916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:41.903244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d8bd2-3527-423f-b613-6ca5768cf460 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:41.915650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0af24c-02c7-4834-9df9-baf0df96f3c3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:41.953130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:41.954415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.954910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.955370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.956787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:41.958642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:41.959191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:41.959959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:41.960332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:41.960674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:41.961494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:41.961797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 76/145] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:41.964974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:41.964974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:41.967856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:41.981506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 70/146] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:41.986599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:42.061415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:42.076838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac55d-935a-4fde-8b99-a9eedff02226 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:42.114572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:42.115893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:42.116218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:42.116585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:42.222465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6cb4-1220-45c1-aa70-5aceaca3e1bd None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:42.235708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:42.256821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:42.258437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:42.291228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:42.292144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:42.292679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:42.292964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:42.295706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:42.297184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:42.298870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 71/147] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:42.305014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:42.385017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:42.415814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 77/148] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:42.417305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:42.514847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997dc77-dbcc-4e76-8f87-a204d2695827 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:42.605548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:42.606223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:42.606693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:42.606960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:42.639583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b63c8f-3304-4cab-8c0c-b7f2a4cc3803 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:42.704298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:42.726203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:42.728619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:42.729846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:42.730198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:42.731891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:42.733399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:42.735308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 78/149] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:42 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:42.745190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:42.795426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:42.796004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:42.859925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:42.944945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00c84-0f14-4925-baf6-aad1f894fffa None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:43.018059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:43.018736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.019021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.019294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.020171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=d79d89fc90a74e709dc9387801d50cf4) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:43.020485 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:43.022627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e607ce-cdd5-48c9-8c86-66a0b58f182b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:43.043952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 79/150] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:42 2022] GET /identity/v3/role_assignments?user.id=d79d89fc90a74e709dc9387801d50cf4&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=b6aee05490564ee3847a4e359279b54f => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:43.051528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7e9c9-0004-42ae-acf8-d218f2c86e7b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.051822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7e9c9-0004-42ae-acf8-d218f2c86e7b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.052015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7e9c9-0004-42ae-acf8-d218f2c86e7b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.055923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 72/151] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:43.057460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 80/152] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:43.065278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:43.082911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.083244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.083503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.121267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:43.122926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:43.284475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:43.286106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 81/153] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:43.314567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93370-c480-4b54-b4b4-16dac5461915 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:43.345996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:43.393596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:43.394484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.394767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.395043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.396687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:43.398225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:43.400141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 73/154] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:43 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:43.410278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:43.450904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:43.546263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2231-1c87-4d53-8432-1011811a3b41 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:43.592736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2dfd5-7e77-4f2b-8eed-5337841d0178 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:43.631619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:43.632856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.633142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.633419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.635101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:43.635765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.636048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.636349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.637191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] RBAC: Adding query filter params (role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=d79d89fc90a74e709dc9387801d50cf4) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:43.637509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:43.638977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a3fe6-e8c1-44bf-b900-8c89a7a121c7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:43.640379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:43.641839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:43.643528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 82/155] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:43.653998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 74/156] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:43 2022] GET /identity/v3/role_assignments?user.id=d79d89fc90a74e709dc9387801d50cf4&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:43.655532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:43.804623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c1f-d030-49c8-a764-69bf319b5293 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:43.820558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:43.838733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946ebba-c7cb-490e-a2f0-fd1ca19eaf31 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.839189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946ebba-c7cb-490e-a2f0-fd1ca19eaf31 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.841858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946ebba-c7cb-490e-a2f0-fd1ca19eaf31 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.841858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 75/157] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:43.846725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.846977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.847218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.857392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:43.858096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:43.858378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:43.858652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:43.859407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:43.860845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:43.862892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:43.877223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:43.878435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:43.956860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 76/158] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:43.982562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.003809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 83/159] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:26:43 2022] POST /identity/v3/users => generated 283 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:44.160206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac0f9-9fd9-453e-8f0f-dc9b36c7a32e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:44.237620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c76df-3883-4d5c-b071-553249bbbcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:44.238464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c76df-3883-4d5c-b071-553249bbbcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.238745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c76df-3883-4d5c-b071-553249bbbcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.239020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c76df-3883-4d5c-b071-553249bbbcb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.243409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:44.260992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c76df-3883-4d5c-b071-553249bbbcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-5e5c76df-3883-4d5c-b071-553249bbbcb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:44.269844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:44.270970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:44.271983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 77/160] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:44.277484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.400406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d829763-1704-48ad-b33a-f3ad7849cc45 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:44.428615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c9de7-3b8f-4434-a239-d39b7d8cda9e None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.428903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c9de7-3b8f-4434-a239-d39b7d8cda9e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.429468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c9de7-3b8f-4434-a239-d39b7d8cda9e None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.430741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 78/161] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:26:44.436715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.437005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.437287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.441953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:44.443093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.443586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.444232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.445215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:44.445726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:44.447393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:44.459022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 84/162] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:44.464771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.465990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:44.467211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:44.508514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:44.598950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 79/163] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:44.614272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965736d-1aa9-4fdb-8f2f-620ddb58a4a9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:44.623794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.658085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:44.658967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.659244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.659514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] PATH_INFO: `/v3/users/e7e53914fdb04c65961b48d4a54b5a8c` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.660798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e53914fdb04c65961b48d4a54b5a8c)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:44.662767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:44.664985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 85/164] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:44 2022] GET /identity/v3/users/e7e53914fdb04c65961b48d4a54b5a8c => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:44.670379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.758369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780f8f3-46d6-4d4e-a325-0cd0bf929316 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:44.778692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:44.786120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe35cf7-3cb6-4f87-a1a6-a95da7bc5c69 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:44.795127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:44.805116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:44.805922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.806201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.806477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.818633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:44.830455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:44.831364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:44.831648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:44.831927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:44.832030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:44.838546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:44.839513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:44.840229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:44.840300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 80/165] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:44.840378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:44.840378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 86/166] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:44 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:44.840496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.844073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:44.980906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8cf7-9470-4621-beb2-e35e78c87c8f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:44.995585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154b48-7477-4966-a035-fd57493eb74c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:45.024290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa33484-6cb1-4903-a021-994810f9e424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:45.025862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa33484-6cb1-4903-a021-994810f9e424 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.026365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa33484-6cb1-4903-a021-994810f9e424 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.026834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa33484-6cb1-4903-a021-994810f9e424 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5/users/e7e53914fdb04c65961b48d4a54b5a8c/roles/647e539bfe0f42ad9807d586f74cffe6` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.029120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa33484-6cb1-4903-a021-994810f9e424 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e75612da3942be997ad038eadd12c5, user_id=e7e53914fdb04c65961b48d4a54b5a8c, role_id=647e539bfe0f42ad9807d586f74cffe6)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:45.030799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa33484-6cb1-4903-a021-994810f9e424 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:45.037685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:45.038413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.038691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.038965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.039741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:45.040044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:45.041466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0ad9-6c72-4e50-be3f-de7e4e169c05 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:45.050515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 81/167] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:45.053982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ca3c7-43aa-4f71-83b7-2797efb2ddde None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.053982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ca3c7-43aa-4f71-83b7-2797efb2ddde None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.053982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ca3c7-43aa-4f71-83b7-2797efb2ddde None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.053982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 82/168] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:45.056934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ca3c7-43aa-4f71-83b7-2797efb2ddde None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:45.117003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:45.120480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 87/169] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:44 2022] PUT /identity/v3/projects/c7e75612da3942be997ad038eadd12c5/users/e7e53914fdb04c65961b48d4a54b5a8c/roles/647e539bfe0f42ad9807d586f74cffe6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:45.123091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.124266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.125296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.172645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:45.175594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:45.216910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:45.231459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ca3c7-43aa-4f71-83b7-2797efb2ddde None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:45.306361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:45.307212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.307491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.307760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] PATH_INFO: `/v3/users/f3324493261445ea97cf7d9e4edb1c3a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.309753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f3324493261445ea97cf7d9e4edb1c3a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:45.311985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:45.313939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 83/170] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:45 2022] GET /identity/v3/users/f3324493261445ea97cf7d9e4edb1c3a => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:45.317800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 88/171] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:45.322253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:45.356643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:45.483018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2fb08-f16e-45d4-8eed-1cb4063e50be None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:45.505133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279f606-1c22-46ba-81d7-db046ed5b2f1 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:45.524459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:45.525277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.525565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.525838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.535744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:45.552197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:45.565461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:45.566580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:45.567548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:45.573335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 89/172] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:45.578058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:45.580282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:45.580943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.581226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.581501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.611795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:45.717560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:45.719031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:45.795114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276881e0-8f40-4602-8227-dfc3c02a42df None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:45.874990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 84/173] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:45.881333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:45.906548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:45.957432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:45.958135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:45.959066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:45.959521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:45.960559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:45.960871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:45.962291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:45.987267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 90/174] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:45.993871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:46.095649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d7c5-bbd9-42d8-8f99-44bc8f7d6627 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:46.179960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:46.181293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:46.181776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:46.182274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:46.188776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:46.190455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:46.199052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 85/175] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:45 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:46.199052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:46.204414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:46.265601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61110d-ef34-4082-9f13-43ec88ebafce None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:46.356842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:46.357749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:46.358037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:46.358310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] PATH_INFO: `/v3/users/d79d89fc90a74e709dc9387801d50cf4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:46.359613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] RBAC: Authorizing `identity:get_user(user_id=d79d89fc90a74e709dc9387801d50cf4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:46.361097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:46.362430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:46.363129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 91/176] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:45 2022] GET /identity/v3/users/d79d89fc90a74e709dc9387801d50cf4 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:46.369107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:46.376396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18fae2-ca30-448b-9a0e-281e87f85e65 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:46.476943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:46.477968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:46.478455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:46.478960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:46.479997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=f3324493261445ea97cf7d9e4edb1c3a) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:46.480620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:46.482272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:46.489027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 86/177] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:46 2022] GET /identity/v3/role_assignments?user.id=f3324493261445ea97cf7d9e4edb1c3a&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:46.564945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ce3f-67bc-4164-bf86-13ee55c530af None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:46.619399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:46.620080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:46.620373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:46.620650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:46.647471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:46.716008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:46.717521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:46.874319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 92/178] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:46.879909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:47.044453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934b0e3-6ba1-400e-b84f-93ba3f23aa89 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:47.095241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181a848-40c5-48a2-9637-1b11c43af2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:47.096165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181a848-40c5-48a2-9637-1b11c43af2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.096449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181a848-40c5-48a2-9637-1b11c43af2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.100074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181a848-40c5-48a2-9637-1b11c43af2d1 None admin] PATH_INFO: `/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181a848-40c5-48a2-9637-1b11c43af2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=a314eb5ad1724d1ba6b9dfad1c4d86d2)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:47.102275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181a848-40c5-48a2-9637-1b11c43af2d1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:47.104201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 87/179] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:46 2022] GET /identity/v3/projects/a314eb5ad1724d1ba6b9dfad1c4d86d2 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:47.113185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:47.176428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:47.244264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e9a2-ce49-4436-a731-16829c9a3406 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:47.287925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:47.288625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.288913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.289191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.290033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=a314eb5ad1724d1ba6b9dfad1c4d86d2, user.id=d79d89fc90a74e709dc9387801d50cf4) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:47.290347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:47.291814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a6ae-d87f-4874-bfb3-fa494fcd5797 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:47.298780 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 93/180] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:47 2022] GET /identity/v3/role_assignments?user.id=d79d89fc90a74e709dc9387801d50cf4&scope.project.id=a314eb5ad1724d1ba6b9dfad1c4d86d2&role.id=b6aee05490564ee3847a4e359279b54f => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:47.424424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613a1a-9393-41dd-8d80-c66f5bfe54a2 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.424955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613a1a-9393-41dd-8d80-c66f5bfe54a2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.424955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613a1a-9393-41dd-8d80-c66f5bfe54a2 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.426768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 88/181] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:47.433641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb456b-2d75-420e-865f-f80f21ec014e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.433959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb456b-2d75-420e-865f-f80f21ec014e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.434198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb456b-2d75-420e-865f-f80f21ec014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.456316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0fdb456b-2d75-420e-865f-f80f21ec014e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:47.457501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0fdb456b-2d75-420e-865f-f80f21ec014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:47.558807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 94/182] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:47.604229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613a1a-9393-41dd-8d80-c66f5bfe54a2 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:47.634895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:47.736354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613a1a-9393-41dd-8d80-c66f5bfe54a2 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:47.773388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:47.774199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.774479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.774754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.785852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:47.794113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:47.795013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:47.795783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 89/183] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:47.803761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301b7c-45e4-44b1-876a-bcfe88cfc71c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.803761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301b7c-45e4-44b1-876a-bcfe88cfc71c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.803973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:47.804045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301b7c-45e4-44b1-876a-bcfe88cfc71c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.804544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 95/184] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:47.810096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.810609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.811083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.832919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:47.835567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:47.874589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:47.890031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:47.915109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2345-65ff-455b-885f-011c025a5f14 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:47.918936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 96/185] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:47.944165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:47.957676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:47.958441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:47.958708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:47.959264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:47.960280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:47.960758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:47.962375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:47.973203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 90/186] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:47.980088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.064376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1974d0-616a-420c-907d-68bdbaed55d0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.102706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca164-9bc3-421e-bed8-908fc267a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.103784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca164-9bc3-421e-bed8-908fc267a13a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.104305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca164-9bc3-421e-bed8-908fc267a13a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.104971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca164-9bc3-421e-bed8-908fc267a13a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.109228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e328b-4026-4f9c-8028-8cd989257381 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.117292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca164-9bc3-421e-bed8-908fc267a13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-c20ca164-9bc3-421e-bed8-908fc267a13a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:48.125478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:48.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:48.127200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 97/187] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:48.127902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78011485-f803-4175-bedb-5883b237eea9 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.128355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78011485-f803-4175-bedb-5883b237eea9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.128785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78011485-f803-4175-bedb-5883b237eea9 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.130380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 98/188] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:48.134427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78011485-f803-4175-bedb-5883b237eea9 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.150253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a297b8f-13ba-44f8-a6ab-fe3f0a2a6b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.151136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a297b8f-13ba-44f8-a6ab-fe3f0a2a6b70 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.151413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a297b8f-13ba-44f8-a6ab-fe3f0a2a6b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.151690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a297b8f-13ba-44f8-a6ab-fe3f0a2a6b70 None admin] PATH_INFO: `/v3/users/73764152943c46309661be18408147e1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.160280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.165994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.167397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a297b8f-13ba-44f8-a6ab-fe3f0a2a6b70 None admin] RBAC: Authorizing `identity:get_user(user_id=73764152943c46309661be18408147e1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.168807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a297b8f-13ba-44f8-a6ab-fe3f0a2a6b70 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.170504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 91/189] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:47 2022] GET /identity/v3/users/73764152943c46309661be18408147e1 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:48.175996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.176393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.176584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.192856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:48.194029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:48.289950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78011485-f803-4175-bedb-5883b237eea9 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.295379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 92/190] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:48.295379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.329447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.330040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.330349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.330625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.331367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:48.331674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.333702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88428fc-ac84-4978-a982-5422ce9c12d5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.346053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 99/191] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:48.346053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a543-9c79-44d5-8677-e74b9270113c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.346053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a543-9c79-44d5-8677-e74b9270113c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.346053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a543-9c79-44d5-8677-e74b9270113c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.346053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 100/192] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:48.346053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a543-9c79-44d5-8677-e74b9270113c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.403799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef26fc9-b8f8-4400-9054-aadfb632f025 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.431361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.437513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.441600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6c04-f2e6-40c2-895c-837ff06ba0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.441600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6c04-f2e6-40c2-895c-837ff06ba0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.441600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6c04-f2e6-40c2-895c-837ff06ba0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.441600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6c04-f2e6-40c2-895c-837ff06ba0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.448674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a543-9c79-44d5-8677-e74b9270113c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.481514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.482303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.482580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.482850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.483993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.485506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.487113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 101/193] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:48.488979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.510521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6c04-f2e6-40c2-895c-837ff06ba0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.511992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6c04-f2e6-40c2-895c-837ff06ba0a6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.588782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197e150-2aea-4cfc-86ec-6ec95b1154c4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.612333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 93/194] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:48.613605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.613900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.614231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.622279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.623157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.623440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.623716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] PATH_INFO: `/v3/users/73764152943c46309661be18408147e1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.624951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] RBAC: Authorizing `identity:get_user(user_id=73764152943c46309661be18408147e1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.626408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.632882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 102/195] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/users/73764152943c46309661be18408147e1 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:48.632882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.633141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:48.633141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:48.653269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.657387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.698733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 94/196] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:48.699557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.730808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01272e4d-cee8-41b0-9cbf-f867cfb343bf None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.764877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.765625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.765908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.766176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.766873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.768349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.805220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1846ba0-7d67-4387-aabb-d5cba8e8339f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.838186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:48.839137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:48.839355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:48.839625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:48.840822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:48.842295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:48.843966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 95/197] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:48.844766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.848234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 103/198] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:26:48 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:26:48.848234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:48.886739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.946502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:48.966740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80829d03-2cf9-4552-a3af-3ac6173e0982 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:48.976937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4213ad-160d-40b3-a89b-0c8627e14c15 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.011228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.012202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.012572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.012856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.018197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.019269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.019725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.020208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.025297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:49.033250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:49.034204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:49.034993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 104/199] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:49.035644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:49.109728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.111220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.141867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:49.160760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c7eb1-eb25-4570-a7ec-c0c68fa8e09a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.203311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.204298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.204726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.205168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.206178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=73764152943c46309661be18408147e1) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:49.206631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.208851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.215134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 105/200] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/role_assignments?user.id=73764152943c46309661be18408147e1&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:49.216385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:49.229720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 96/201] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:49.231446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:49.235206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:49.345129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0e77-e96d-4b0d-8e70-352b72be6b9f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.359273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce189f-1f4b-4c6d-b7d7-f6b6218a681e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.385657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.386597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.386884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.387229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.388170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:49.389303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:49.389814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.391379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.402029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 106/202] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:49.408219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:49.413700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.415957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.422758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.423263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.424918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.426784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.429752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 97/203] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:49.435738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:49.528970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:49.570225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225297d3-df98-4deb-9f96-01aa20a6aea4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.611944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.613083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.613505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.613918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] PATH_INFO: `/v3/users/e7e53914fdb04c65961b48d4a54b5a8c` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.620875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] RBAC: Authorizing `identity:get_user(user_id=e7e53914fdb04c65961b48d4a54b5a8c)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.622588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.624478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 107/204] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/users/e7e53914fdb04c65961b48d4a54b5a8c => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:49.630732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:49.679407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284380-9a42-4f78-a069-1bd6dd8512c7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.750960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef515255-d69a-4bcd-927c-b370e928072f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:49.769296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.769965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.770573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.770573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.771559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] RBAC: Adding query filter params (role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=73764152943c46309661be18408147e1) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:49.771872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.773335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.790430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 98/205] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/role_assignments?user.id=73764152943c46309661be18408147e1&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:49.792502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:49.793346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:49.793773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:49.794186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:49.798881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:49.874568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:49.876393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:49.988494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 108/206] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:49.997239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:50.084244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:50.130189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15566c-ec48-4cc8-bd2e-44d407e6a4ca None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:50.169519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f564f-3f59-493d-a7a7-2bbd6bf1e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:50.170386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f564f-3f59-493d-a7a7-2bbd6bf1e9ef None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:50.170666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f564f-3f59-493d-a7a7-2bbd6bf1e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:50.170939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f564f-3f59-493d-a7a7-2bbd6bf1e9ef None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:50.172151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f564f-3f59-493d-a7a7-2bbd6bf1e9ef None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:50.173588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f564f-3f59-493d-a7a7-2bbd6bf1e9ef None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:50.175276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 99/207] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:49 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:50.181615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:50.218741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:50.290643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ec0d-2060-4ea9-8053-42017011dee2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:50.330762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:50.331426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:50.331748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:50.332020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:50.333502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] RBAC: Adding query filter params (role.id=647e539bfe0f42ad9807d586f74cffe6, scope.project.id=c7e75612da3942be997ad038eadd12c5, user.id=e7e53914fdb04c65961b48d4a54b5a8c) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:50.333813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:50.335324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaf4b1-09ec-4de1-8146-a8fcb06feda4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:50.341824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 109/208] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:50 2022] GET /identity/v3/role_assignments?user.id=e7e53914fdb04c65961b48d4a54b5a8c&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=647e539bfe0f42ad9807d586f74cffe6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:51.519929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb841-63ad-43c4-a7d6-744e9cc1bdb3 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.520495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb841-63ad-43c4-a7d6-744e9cc1bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.520593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb841-63ad-43c4-a7d6-744e9cc1bdb3 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.522281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 100/209] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:51.528223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.528724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.528997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.547371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:51.548608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:51.576341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db46a3e-0a0e-4c98-8b26-67906384a0ee None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.576635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db46a3e-0a0e-4c98-8b26-67906384a0ee None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.576908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db46a3e-0a0e-4c98-8b26-67906384a0ee None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.578512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 101/210] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:51.584077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.584375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.584727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.602210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:51.603415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:51.632214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 110/211] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:51.651676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:51.681964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 102/212] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:51.684413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:51.707120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:51.764237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ee56-cd01-4d77-ad8d-2a11e4fb28cf None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:51.784607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:51.802323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:51.803459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.803937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.804455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.816278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:51.825644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:51.826554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:51.827320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:51.829898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 111/213] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:51.836755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:51.838881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037c2b8-66b0-48b6-ad5a-29e42d4fb536 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:51.878314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04388ab2-718e-4082-9e0f-e89cbbeab660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:51.879125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04388ab2-718e-4082-9e0f-e89cbbeab660 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.880176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04388ab2-718e-4082-9e0f-e89cbbeab660 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.880576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04388ab2-718e-4082-9e0f-e89cbbeab660 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.881888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04388ab2-718e-4082-9e0f-e89cbbeab660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:51.883351 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04388ab2-718e-4082-9e0f-e89cbbeab660 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:51.885222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 103/214] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:51.886220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987250ad-69e9-494a-998a-5e8374e57280 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.886505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987250ad-69e9-494a-998a-5e8374e57280 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.886778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987250ad-69e9-494a-998a-5e8374e57280 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.888011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 104/215] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:51.890624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987250ad-69e9-494a-998a-5e8374e57280 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:51.941156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:51.952337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1562c-1b31-426f-8ec4-a4828fc7ab91 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:51.989986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:51.990664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:51.990947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:51.991226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:51.991971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:51.992311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:51.993713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2715e1f-0f61-4eef-93b7-f53e5578bde1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:52.002258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 112/216] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:52.003279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.003568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.003846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.013170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987250ad-69e9-494a-998a-5e8374e57280 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.022504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:52.024042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:52.037721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.049733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.050411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.050693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.050971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.052458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:52.056103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:52.094582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 113/217] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:52.095133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.134802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 105/218] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:26:51 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:26:52.135787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.210799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.232646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0134dad-461b-4ec5-baa0-34124e484b7f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.275466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.276413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.276694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.276968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] PATH_INFO: `/v3/users/d453d43c00dc48a291ca8b59336b8a1e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.287258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2250373-15c6-4233-a5b3-d22637a88d46 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.293302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d453d43c00dc48a291ca8b59336b8a1e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:52.294719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:52.300083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 114/219] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/users/d453d43c00dc48a291ca8b59336b8a1e => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:52.309493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.331403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.332844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.333284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.333713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.345345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:52.356364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:52.357312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:52.358091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 106/220] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:52.366945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.416433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.440539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9cb35-ac7c-415c-81a3-ba4ad36568f5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.479302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.481496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.481496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.481496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.494665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.501586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec85259-59dd-4a2b-bdfd-be6de15594c2 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.545931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.546536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.546806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.547086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.547965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:52.548316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:52.549696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc738-5567-445a-aab9-39de8ace5673 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:52.559481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 107/221] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:52.560842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc90b-e95f-443f-8abc-c27c47f72baf None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.561131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc90b-e95f-443f-8abc-c27c47f72baf None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.561408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc90b-e95f-443f-8abc-c27c47f72baf None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.562801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 108/222] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:52.568242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.568542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.568806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.571697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:52.573232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:52.588831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:52.590145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:52.665933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 109/223] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:52.667743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.699769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.707529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 115/224] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:52.708704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.762528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.778516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df566d-7f73-4aca-a51f-ee749bf7c4d4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.816269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.818249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.818675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.819098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] PATH_INFO: `/v3/users/73764152943c46309661be18408147e1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.820448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] RBAC: Authorizing `identity:get_user(user_id=73764152943c46309661be18408147e1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:52.822013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:52.823907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 110/225] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/users/73764152943c46309661be18408147e1 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:52.828407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.841437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f30b-75e9-448d-9510-130f02d36394 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:52.878985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:52.880487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:52.880857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:52.881455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:52.895145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:52.906110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:52.906992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:52.907793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 116/226] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:52.909018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:52.960517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:52.964581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676ed2-538d-45c2-984b-51f3981ce05e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.012963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:53.014144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.015336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.015790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.016292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.016670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa5398-b66e-4cc9-841e-6ea6601a5ee8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.017887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.020790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.022740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 111/227] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:53.024192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:53.060539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.061440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.061728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.062076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.063193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.064918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.066551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 117/228] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:52 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:53.071816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:53.164797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91c27-fb4e-4dac-b2d0-8a803242514f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.202326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.203008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.203295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.203574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.204366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:53.204685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.204997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0270e5e-ff36-46c9-961b-bea65c44c814 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.206109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.215895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 112/229] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:53.216731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:53.245419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.246479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.247034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.247526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.248769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=d453d43c00dc48a291ca8b59336b8a1e) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:53.249291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.250989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.257395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 118/230] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:53 2022] GET /identity/v3/role_assignments?user.id=d453d43c00dc48a291ca8b59336b8a1e&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=b6aee05490564ee3847a4e359279b54f => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:53.258413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:53.309809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:53.338966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:53.399286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faba751-0c6b-4200-9abc-209032400a12 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.468890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db825b-5cee-4973-9b29-2679f14ca304 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.487194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.488093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.488378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.489172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87/users/73764152943c46309661be18408147e1/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.495577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] RBAC: Authorizing `identity:create_grant(project_id=56677e6f8c3649888934255bb9b49b87, user_id=73764152943c46309661be18408147e1, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.497048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.515784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.517165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.517632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.518069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] PATH_INFO: `/v3/users/73764152943c46309661be18408147e1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.521179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] RBAC: Authorizing `identity:get_user(user_id=73764152943c46309661be18408147e1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.522929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.524977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 119/231] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:53 2022] GET /identity/v3/users/73764152943c46309661be18408147e1 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:53.532917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:53.585199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 113/232] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:53 2022] PUT /identity/v3/projects/56677e6f8c3649888934255bb9b49b87/users/73764152943c46309661be18408147e1/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:53.647562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:53.651112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e7fe4-07f6-4d1e-9b8f-6832a5ac168d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.693977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dc7e5-6376-47f4-951b-743ceb8752f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.695321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dc7e5-6376-47f4-951b-743ceb8752f4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.695808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dc7e5-6376-47f4-951b-743ceb8752f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.696310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dc7e5-6376-47f4-951b-743ceb8752f4 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.698084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dc7e5-6376-47f4-951b-743ceb8752f4 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.699828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dc7e5-6376-47f4-951b-743ceb8752f4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:53.702267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 120/233] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:53 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:53.708557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:53.852856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:53.868015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a661b39-feb4-4eb0-88ef-8d6089efa0dd None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:53.911060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2bff-4c76-4932-92d6-34bcf56cfe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:53.912175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2bff-4c76-4932-92d6-34bcf56cfe89 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:53.912468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2bff-4c76-4932-92d6-34bcf56cfe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:53.912751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2bff-4c76-4932-92d6-34bcf56cfe89 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87/users/73764152943c46309661be18408147e1/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:53.915055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2bff-4c76-4932-92d6-34bcf56cfe89 None admin] RBAC: Authorizing `identity:create_grant(project_id=56677e6f8c3649888934255bb9b49b87, user_id=73764152943c46309661be18408147e1, role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:53.916873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2bff-4c76-4932-92d6-34bcf56cfe89 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:54.025415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 114/234] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:53 2022] PUT /identity/v3/projects/56677e6f8c3649888934255bb9b49b87/users/73764152943c46309661be18408147e1/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:54.885183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf2c23-873b-40eb-b728-b12c5b553539 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:54.885183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf2c23-873b-40eb-b728-b12c5b553539 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:54.885183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf2c23-873b-40eb-b728-b12c5b553539 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:54.886340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 121/235] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:54.890589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:54.891411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:54.891901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:54.917298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:54.918807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:54.936176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e02c87-46c8-4429-8d3a-a2e9d876629a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:54.936457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e02c87-46c8-4429-8d3a-a2e9d876629a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:54.936729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e02c87-46c8-4429-8d3a-a2e9d876629a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:54.938382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 122/236] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:54.943429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:54.943721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:54.944004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:54.961528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:54.962827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:55.034292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 115/237] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:55.035472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 123/238] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:55.060463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:55.069074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:55.228149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:55.245214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:55.249462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ebd76-fd6a-49f8-9be0-a9169a99b206 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:55.290486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937951c-6421-4145-85a0-afef9fcd7649 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:55.294141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:55.295188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.295633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.296096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.318657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:55.328001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:55.329267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:26:55.330083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:55.337822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 124/239] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:55.338925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:55.376757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:55.377568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.377855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.381580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:55.383121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:55.385327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 116/240] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:55.393384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:55.450925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea5c30-dcfb-4a2d-81cc-2c05ea348aa5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:55.487970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:55.489118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.489608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.490106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.491048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:55.491610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:55.493322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:55.503678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 125/241] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:55.510688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:55.535141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:55.590880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492449a-7d47-4583-9d89-c79a7ce00fbc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:55.632316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37463c5e-48a5-4c55-9876-923e9879914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:55.633370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37463c5e-48a5-4c55-9876-923e9879914d None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.633891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37463c5e-48a5-4c55-9876-923e9879914d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.634401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37463c5e-48a5-4c55-9876-923e9879914d None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.635569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37463c5e-48a5-4c55-9876-923e9879914d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:55.637606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37463c5e-48a5-4c55-9876-923e9879914d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:55.684347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dcc0c-eca8-44f7-a501-6343ca295afc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:55.721052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:55.722344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.723446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.724019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] PATH_INFO: `/v3/users/465a8ad4220044b1ae2c472772b05ac7` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.739223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] RBAC: Authorizing `identity:get_user(user_id=465a8ad4220044b1ae2c472772b05ac7)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:55.741101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:55.743344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 126/242] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:55 2022] GET /identity/v3/users/465a8ad4220044b1ae2c472772b05ac7 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:55.748805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:55.779054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 117/243] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:26:55 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:26:55.862125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:55.892816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d80001-7093-4a00-abf2-cd4fe8256878 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:55.931767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:55.932470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.932754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.933031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.989477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd830-1884-4add-bf1b-bb3185b3c81a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.990418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd830-1884-4add-bf1b-bb3185b3c81a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.990892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fd830-1884-4add-bf1b-bb3185b3c81a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:55.992733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 118/244] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:55.998502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:55.999071 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:55.999567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.005883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:56.014390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:56.015974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:56.020394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:56.021978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:56.151112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:56.152553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 119/245] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:56.175525 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.188386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 127/246] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 13:26:56.194321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.328237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ba580-536e-497b-b7d5-18afd5d8b22d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:56.338500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af59cf-b748-4fce-8a2a-99b642649904 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:56.373403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:56.381777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:56.382960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.383447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.383917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.387483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:56.395040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.395040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.395040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.395040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:56.395040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:56.395040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 128/247] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:56.401153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.402537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:56.411789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:56.412722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:56.413505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:56.416511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 120/248] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:56.422472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.480225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:56.555957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684815-185f-47ba-9a91-476ce976bd8c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:56.561233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941f15-8067-401e-9800-fd056d414624 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:56.601984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:56.602643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.602849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.603124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.603957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] RBAC: Adding query filter params (role.id=647e539bfe0f42ad9807d586f74cffe6, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=465a8ad4220044b1ae2c472772b05ac7) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:56.604289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:56.605727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ba689-b1a7-4e30-aea7-a02227fafe97 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:56.606450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:56.607127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.607685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.607975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.609292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:56.609605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:56.611283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:56.612369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 129/249] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/role_assignments?user.id=465a8ad4220044b1ae2c472772b05ac7&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=647e539bfe0f42ad9807d586f74cffe6 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:56.614270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1440-a4e3-4397-859e-c2292a20925b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.614665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1440-a4e3-4397-859e-c2292a20925b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.614942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1440-a4e3-4397-859e-c2292a20925b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.621866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 121/250] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:56.624365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 130/251] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:56.627498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.631958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.632294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.632562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.671374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:56.672713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:56.774257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:56.832607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 131/252] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:56.856116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862583d3-ac97-4c10-aea7-be3478a61c46 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:56.868773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.899170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f0267-57fb-4575-a7ec-644b4061bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:56.900545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f0267-57fb-4575-a7ec-644b4061bc2c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.900834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f0267-57fb-4575-a7ec-644b4061bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.901115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f0267-57fb-4575-a7ec-644b4061bc2c None admin] PATH_INFO: `/v3/users/d453d43c00dc48a291ca8b59336b8a1e` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.902484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f0267-57fb-4575-a7ec-644b4061bc2c None admin] RBAC: Authorizing `identity:get_user(user_id=d453d43c00dc48a291ca8b59336b8a1e)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:56.903982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f0267-57fb-4575-a7ec-644b4061bc2c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:56.906943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 122/253] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/users/d453d43c00dc48a291ca8b59336b8a1e => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:56.908288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa7541-9d90-4533-847b-3cab9bb58c56 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:56.908585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa7541-9d90-4533-847b-3cab9bb58c56 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:56.908888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa7541-9d90-4533-847b-3cab9bb58c56 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:56.915502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 123/254] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:56.915502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa7541-9d90-4533-847b-3cab9bb58c56 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:56.935053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:57.016333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49395-a84f-4faa-862a-02af88a78a27 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.060452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32765411-19f1-4c4e-af07-8ba2c560ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.061649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32765411-19f1-4c4e-af07-8ba2c560ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.061935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32765411-19f1-4c4e-af07-8ba2c560ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.062216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32765411-19f1-4c4e-af07-8ba2c560ec89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.073852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32765411-19f1-4c4e-af07-8ba2c560ec89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:57.074804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa7541-9d90-4533-847b-3cab9bb58c56 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-32765411-19f1-4c4e-af07-8ba2c560ec89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:57.086770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:57.087710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 132/255] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:26:57.088548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.089275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.089275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.129626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:57.131084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:57.138590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:57.161577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.162467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.162734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.163015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.165009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:57.166763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:57.169861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 124/256] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:56 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:57.170657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:57.262820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 133/257] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:57.269066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:57.346497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:57.379474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c847aa-6195-4f7a-8238-d9b3de15fd4a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.450725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.451776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.453069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.453548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.454497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:57.455787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:57.458085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:57.472228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 125/258] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:57.473436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:57.491998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86700b-6454-4141-89d3-c5bceaf50bc5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.529282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:57.574279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.576467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.577646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.579444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87/users/d453d43c00dc48a291ca8b59336b8a1e/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.583752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] RBAC: Authorizing `identity:create_grant(project_id=56677e6f8c3649888934255bb9b49b87, user_id=d453d43c00dc48a291ca8b59336b8a1e, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:57.585657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:57.588159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd61d8-1c8b-4c89-9e41-2f91158c936a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.629477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.630872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.631377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.631955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.643609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:57.652664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:57.653638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:26:57.654530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:26:57.657345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 126/259] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:26:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:57.658333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:57.678928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 134/260] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:26:57 2022] PUT /identity/v3/projects/56677e6f8c3649888934255bb9b49b87/users/d453d43c00dc48a291ca8b59336b8a1e/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:26:57.679871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:57.772234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074711f8-89eb-48df-898a-dbfea330689d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.787375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:57.834041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.836147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.837498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.840685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] PATH_INFO: `/v3/users/73764152943c46309661be18408147e1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.843574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] RBAC: Authorizing `identity:get_user(user_id=73764152943c46309661be18408147e1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:57.845482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:57.848566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 127/261] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:57 2022] GET /identity/v3/users/73764152943c46309661be18408147e1 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:57.854210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:57.912462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:57.930211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f445-2a8a-4b78-a611-4b5b3835611a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:57.985255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:57.986015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:57.986300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:57.986574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:57.987422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:57.987725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:57.989784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:57.999898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 135/262] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:26:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:58.005601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:58.028911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce94b4-55e5-490b-8278-9f0902903b69 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:58.074762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:58.076912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:58.077443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:58.077516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:58.174682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:58.221180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:58.221972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeb63e-43a2-40d6-b006-681e28cfe7ea None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:58.223323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:58.308871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:58.309685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:58.309970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:58.310245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] PATH_INFO: `/v3/users/73764152943c46309661be18408147e1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:58.311504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] RBAC: Authorizing `identity:get_user(user_id=73764152943c46309661be18408147e1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:58.313010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:58.314683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 136/263] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:26:58 2022] GET /identity/v3/users/73764152943c46309661be18408147e1 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:58.327755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:58.381047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:58.416814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 128/264] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:26:58.422037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:58.546815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba270b0-2eb7-49a3-9f4b-f89bb10f92fb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:58.585485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:58.620944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:58.621994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:58.623116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:58.623592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:58.626491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf978e-574c-401a-a2d4-ccc99533f127 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:58.678490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:58.679812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:58.680323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:58.680848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:58.682293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:58.684187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:58.686131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 129/265] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:58 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:58.692138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:58.710143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:58.710143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:58.732513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:58.818718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 137/266] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 13:26:58.824173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:58.833572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30d67-ddc6-486b-b78f-5f4f40aa9ecc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:58.880495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:58.881513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:58.882000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:58.882616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:58.883768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=73764152943c46309661be18408147e1) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:58.884318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:58.886068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:58.898698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 130/267] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:58 2022] GET /identity/v3/role_assignments?user.id=73764152943c46309661be18408147e1&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:58.939210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98763e26-65a3-4c14-90bd-4bd0f9f68732 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:58.963093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:58.980148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd20394-6883-42bf-913c-cdfba6701178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:58.981054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd20394-6883-42bf-913c-cdfba6701178 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:58.981333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd20394-6883-42bf-913c-cdfba6701178 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:58.981604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd20394-6883-42bf-913c-cdfba6701178 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:58.983026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd20394-6883-42bf-913c-cdfba6701178 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:58.984574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd20394-6883-42bf-913c-cdfba6701178 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:58.986420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 138/268] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:26:58 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:26:58.992864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:59.019080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:59.183024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9d04-d037-4cab-b630-3d1b16181618 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:59.219647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:59.220353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.220640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.220920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.221771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] RBAC: Adding query filter params (role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=73764152943c46309661be18408147e1) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:59.222086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:59.223655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5dcf2-7f9f-4a14-a989-542216b84f09 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:59.230686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 131/269] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:26:58 2022] GET /identity/v3/role_assignments?user.id=73764152943c46309661be18408147e1&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:59.443214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a480c5a-df41-4329-8d3b-10103ee57e3d None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.444565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a480c5a-df41-4329-8d3b-10103ee57e3d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.444855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a480c5a-df41-4329-8d3b-10103ee57e3d None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.446550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 139/270] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:59.452013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42180a-d002-4001-b3e1-cc14e325febd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.452334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42180a-d002-4001-b3e1-cc14e325febd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.452622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42180a-d002-4001-b3e1-cc14e325febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.478590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-cd42180a-d002-4001-b3e1-cc14e325febd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:59.479820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cd42180a-d002-4001-b3e1-cc14e325febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:59.575132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 132/271] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:26:59.601311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a480c5a-df41-4329-8d3b-10103ee57e3d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:59.669625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc339-cffe-4a14-aff2-a796d35f1c25 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.670077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc339-cffe-4a14-aff2-a796d35f1c25 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.670459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc339-cffe-4a14-aff2-a796d35f1c25 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.672228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 133/272] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:59.682010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5b23-d9b1-44f7-b09f-08ea0d56c4b2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.682438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5b23-d9b1-44f7-b09f-08ea0d56c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.682723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5b23-d9b1-44f7-b09f-08ea0d56c4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.705107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:59.714883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d09c5b23-d9b1-44f7-b09f-08ea0d56c4b2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:59.729721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d09c5b23-d9b1-44f7-b09f-08ea0d56c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:59.746251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a480c5a-df41-4329-8d3b-10103ee57e3d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:59.781770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392cf6a-80f7-469f-adeb-e2e8f15f1eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:59.782558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392cf6a-80f7-469f-adeb-e2e8f15f1eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.782836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392cf6a-80f7-469f-adeb-e2e8f15f1eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.783104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392cf6a-80f7-469f-adeb-e2e8f15f1eb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.796074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392cf6a-80f7-469f-adeb-e2e8f15f1eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-f392cf6a-80f7-469f-adeb-e2e8f15f1eb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:26:59.803860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:26:59.804923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:26:59.805760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 140/273] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:26:59.806402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016f087-1215-4dde-98c7-c02797574f56 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.806840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016f087-1215-4dde-98c7-c02797574f56 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.806840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016f087-1215-4dde-98c7-c02797574f56 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.808237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 141/274] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:26:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:26:59.812117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016f087-1215-4dde-98c7-c02797574f56 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:59.814738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 134/275] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:59.816469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.816819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.817101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.834972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:26:59.836363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:26:59.871823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:59.906412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 135/276] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:26:59.907249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:26:59.934063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016f087-1215-4dde-98c7-c02797574f56 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:26:59.973416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:26:59.974013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:26:59.974529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:26:59.974637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:26:59.975288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:26:59.975594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:26:59.977036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:26:59.978599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:26:59.985710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 142/277] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:26:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:26:59.991344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.018620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28e848-6269-49e3-9b09-6942aa8ed1bf None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.057119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.058036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.058322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.058603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.070639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:00.078506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:00.079415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:00.080247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 136/278] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:26:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:00.080898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.106777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e0b3-62a2-40e4-af30-a2b1cc6427fc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.118860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:00.143150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.144032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.144399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.144767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.145925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.147394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.149616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 143/279] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:00.150416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.198369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09603-fa83-4fd7-8cd2-ab97aa667da5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.226450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:00.234830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.235746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.236272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.236364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] PATH_INFO: `/v3/users/ece4418d314b40638bfeb77e5f4bf7d1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.273509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=ece4418d314b40638bfeb77e5f4bf7d1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.275127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.277057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 137/280] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:00 2022] GET /identity/v3/users/ece4418d314b40638bfeb77e5f4bf7d1 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:00.277645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.299272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a714-3ebd-40ea-b580-9cbbb6384e84 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.337926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.338603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.338882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.339154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.340071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:00.340387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.341758 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.350164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 144/281] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:00.350966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.395308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:00.406064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ff65-fb51-42b8-b219-8c49f99ce2f5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.445143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.446095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.446565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.447030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.447754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.449218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.456845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832e681-597e-4201-957b-464bc9b2d350 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.490933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.491521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.491801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.492101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.492928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, user.id=ece4418d314b40638bfeb77e5f4bf7d1, scope.system=all) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:00.493237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.494669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.499952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 145/282] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 8 13:27:00 2022] GET /identity/v3/role_assignments?user.id=ece4418d314b40638bfeb77e5f4bf7d1&scope.system=all&role.id=b6aee05490564ee3847a4e359279b54f => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:00.500598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.544356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 138/283] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:00 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:00.638368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0834fa-2c17-4654-a3c0-4e62d7b06f36 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.641395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:00.681800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23a1c5-bb60-45a1-a237-f625c9dc209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.682713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23a1c5-bb60-45a1-a237-f625c9dc209d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.682999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23a1c5-bb60-45a1-a237-f625c9dc209d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.683279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23a1c5-bb60-45a1-a237-f625c9dc209d None admin] PATH_INFO: `/v3/users/465a8ad4220044b1ae2c472772b05ac7` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.684615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23a1c5-bb60-45a1-a237-f625c9dc209d None admin] RBAC: Authorizing `identity:get_user(user_id=465a8ad4220044b1ae2c472772b05ac7)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.686107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23a1c5-bb60-45a1-a237-f625c9dc209d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.688370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 146/284] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:00 2022] GET /identity/v3/users/465a8ad4220044b1ae2c472772b05ac7 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:00.694722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.745698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:00.753856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36d740-2c14-4af5-aeff-936b360bd7cb None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.754442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36d740-2c14-4af5-aeff-936b360bd7cb None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.754728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36d740-2c14-4af5-aeff-936b360bd7cb None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.757023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 147/285] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:00.765650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.766111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.766658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.792212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:00.795652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:00.825582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432751-c082-4c58-9f90-59849850a6a0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:00.869122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:00.870221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:00.871040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:00.871448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:00.874316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:00.875997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:00.879447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 139/286] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:00 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:00.886519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:00.892445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 148/287] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:00.920456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:01.020339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4813-5936-4df9-af78-22f7d60c8029 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:01.036742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:01.063499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:01.064459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:01.064811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:01.065088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87/users/465a8ad4220044b1ae2c472772b05ac7/roles/647e539bfe0f42ad9807d586f74cffe6` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:01.067961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=56677e6f8c3649888934255bb9b49b87, user_id=465a8ad4220044b1ae2c472772b05ac7, role_id=647e539bfe0f42ad9807d586f74cffe6)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:01.069696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:01.079403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b794c-8fc1-405b-9e21-14a150e1f3a4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:01.081340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:01.123528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:01.124394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:01.124732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:01.125013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:01.138570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 140/288] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:27:00 2022] PUT /identity/v3/projects/56677e6f8c3649888934255bb9b49b87/users/465a8ad4220044b1ae2c472772b05ac7/roles/647e539bfe0f42ad9807d586f74cffe6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:01.146310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:01.154839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:01.155767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:01.156676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 149/289] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:01.163635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:01.279328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673ce0f-8d5a-4b77-9b3c-24afbfc73fc2 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:01.318224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:01.318908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:01.319195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:01.319472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:01.320301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:01.320665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:01.322094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:01.336415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 141/290] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:01.337900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:01.464948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6c4f4-6ee9-4fbc-add6-eb783e51efec None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:01.513862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:01.515311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:01.515778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:01.516246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] PATH_INFO: `/v3/users/d453d43c00dc48a291ca8b59336b8a1e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:01.517479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] RBAC: Authorizing `identity:get_user(user_id=d453d43c00dc48a291ca8b59336b8a1e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:01.519479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:01.521458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 150/291] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:01 2022] GET /identity/v3/users/d453d43c00dc48a291ca8b59336b8a1e => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:01.526555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:01.572850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:01.676900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db074-02f8-4532-9ebb-2309984b378c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:01.717458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:01.718354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:01.718783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:01.719202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:01.792361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:01.794072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:01.828679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:01.932461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 142/292] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:01.937987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:01.995388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:02.111798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea5bda-0af4-4fc9-950d-065f6d001269 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:02.170115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b625c5c-0a22-4f87-962f-c8eda5c45706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:02.171231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b625c5c-0a22-4f87-962f-c8eda5c45706 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:02.171655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b625c5c-0a22-4f87-962f-c8eda5c45706 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:02.172133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b625c5c-0a22-4f87-962f-c8eda5c45706 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:02.176752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b625c5c-0a22-4f87-962f-c8eda5c45706 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:02.178355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b625c5c-0a22-4f87-962f-c8eda5c45706 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:02.180242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 151/293] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:01 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:02.185944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:02.301665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bdbd4-9f16-4a48-a6ce-442a22d9dc2d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:02.333744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:02.339352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:02.340023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:02.344534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:02.344760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:02.345680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=d453d43c00dc48a291ca8b59336b8a1e) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:02.346001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:02.347660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29145c93-9909-426c-8ece-a1c013930b1f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:02.357009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 143/294] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:02 2022] GET /identity/v3/role_assignments?user.id=d453d43c00dc48a291ca8b59336b8a1e&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=b6aee05490564ee3847a4e359279b54f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:03.261108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead4490-392c-404d-8846-699d26f82ae4 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.261615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead4490-392c-404d-8846-699d26f82ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.261688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead4490-392c-404d-8846-699d26f82ae4 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.263167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 152/295] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:03.268772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12fa77-1d30-41e6-91c6-024d002b6675 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.269319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12fa77-1d30-41e6-91c6-024d002b6675 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.269807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12fa77-1d30-41e6-91c6-024d002b6675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.287439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-bd12fa77-1d30-41e6-91c6-024d002b6675 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:03.288982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bd12fa77-1d30-41e6-91c6-024d002b6675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:03.358820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 144/296] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:03.382622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead4490-392c-404d-8846-699d26f82ae4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:03.427192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a575b-677f-4f39-9a5f-bae97706dfd7 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.427480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a575b-677f-4f39-9a5f-bae97706dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.427936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a575b-677f-4f39-9a5f-bae97706dfd7 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.429345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 145/297] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:03.434596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81bf14-48fc-44ec-b160-70b3d13c1f23 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.435095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81bf14-48fc-44ec-b160-70b3d13c1f23 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.435549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81bf14-48fc-44ec-b160-70b3d13c1f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.458752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1d81bf14-48fc-44ec-b160-70b3d13c1f23 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:03.460306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1d81bf14-48fc-44ec-b160-70b3d13c1f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:03.510988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:03.516099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead4490-392c-404d-8846-699d26f82ae4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:03.535622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 146/298] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:03.537187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecb4d6-9d0c-4b4c-95f9-70865ecf3821 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.537606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecb4d6-9d0c-4b4c-95f9-70865ecf3821 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.538043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecb4d6-9d0c-4b4c-95f9-70865ecf3821 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.539441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 147/299] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:03.545475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.545761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.546037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.566272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:03.567641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:03.567756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:03.568563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.568844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.569113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.580781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:03.589455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:03.590430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:03.591248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 153/300] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:03.592016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:03.629708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:03.648711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 148/301] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:03.649807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:03.715258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf91dfb-870b-447a-b91d-32b85fa4852e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:03.750918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:03.751709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.751991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.752293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.753518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:03.754954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:03.756603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 154/302] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:03.756603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:03.761311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326daee-8934-4ff3-8751-d4327bfdb9e5 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:03.793464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:03.797773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:03.798354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.798647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.798840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.799743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:03.800761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:03.802768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:03.812386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 149/303] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:03.813596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:03.869302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:03.872723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a0a1f-c7cf-4e54-a114-7fa57b863c23 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:03.911115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:03.911839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.912155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.912434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.925669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:03.927834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d1ba-95bf-4eb2-95ed-5cbeea9f8e64 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:03.933462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:03.934344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:03.935243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 155/304] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:03.935899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:03.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:03.964532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:03.964820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:03.965166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] PATH_INFO: `/v3/groups` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:03.965789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:03.967222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.021510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:04.036422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d2d0-e640-4d62-8ac4-d693129d8667 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.067890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087d617-2266-412e-87d2-d50df883544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.068793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087d617-2266-412e-87d2-d50df883544f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.069076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087d617-2266-412e-87d2-d50df883544f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.069366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087d617-2266-412e-87d2-d50df883544f None admin] PATH_INFO: `/v3/users/ece4418d314b40638bfeb77e5f4bf7d1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.070520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087d617-2266-412e-87d2-d50df883544f None admin] RBAC: Authorizing `identity:get_user(user_id=ece4418d314b40638bfeb77e5f4bf7d1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.071953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087d617-2266-412e-87d2-d50df883544f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.073585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 156/305] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:03 2022] GET /identity/v3/users/ece4418d314b40638bfeb77e5f4bf7d1 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:04.074868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf64f-8205-4510-9010-546010bd7a5a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.075150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf64f-8205-4510-9010-546010bd7a5a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.075433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf64f-8205-4510-9010-546010bd7a5a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.076693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 157/306] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:04.081381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf64f-8205-4510-9010-546010bd7a5a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.092085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 150/307] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jun 8 13:27:03 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:04.092085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.201283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf64f-8205-4510-9010-546010bd7a5a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.226248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085bd98-bbea-4125-841a-147628c0e154 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.234884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:04.239762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.240730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.241010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.241304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.242031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:04.242336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.250508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abeabe-6265-4679-93c9-fde5ae01582d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.258985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 158/308] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:04.258985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.258985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.258985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.271698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.272713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.272998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.273285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] PATH_INFO: `/v3/system/users/ece4418d314b40638bfeb77e5f4bf7d1/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.274847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ece4418d314b40638bfeb77e5f4bf7d1, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.276014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:04.279662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.279777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:04.290032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:04.347139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 159/309] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:04.348093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.364847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 151/310] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jun 8 13:27:04 2022] PUT /identity/v3/system/users/ece4418d314b40638bfeb77e5f4bf7d1/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:04.391652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.464144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c16c5-62c2-41fa-bc05-c3caee143963 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.511783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.513081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.513605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.514060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] PATH_INFO: `/v3/users/02a5b53a33194e2fb3c024b13c747798` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.514509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5499a-ba69-404b-b99a-1da6bda6401e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.530713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] RBAC: Authorizing `identity:get_user(user_id=02a5b53a33194e2fb3c024b13c747798)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.532751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.541071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 160/311] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/users/02a5b53a33194e2fb3c024b13c747798 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:04.542827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.547313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:04.559484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.560656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.561168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.561637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.574414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:04.584936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:04.585872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:04.586698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:04.588931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 152/312] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:04.597736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.631380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:04.677771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720362e-f637-4c60-99db-d9c47c316de3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.710137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2019e-5186-4a34-b0a0-7dee9a663390 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.723480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.724449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.724801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.725140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.726284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] RBAC: Adding query filter params (role.id=647e539bfe0f42ad9807d586f74cffe6, user.id=02a5b53a33194e2fb3c024b13c747798, scope.system=all) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:04.726667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.728947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.736115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 161/313] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/role_assignments?user.id=02a5b53a33194e2fb3c024b13c747798&scope.system=all&role.id=647e539bfe0f42ad9807d586f74cffe6 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:04.760142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.761150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.761638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.762087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.763048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:04.763532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.765189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.775812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 153/314] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:04.785636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:04.868826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:04.907723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa584b-d593-4ebf-90b7-ec62b89f483a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:04.947770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:04.948727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:04.949014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:04.949289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] PATH_INFO: `/v3/users/465a8ad4220044b1ae2c472772b05ac7` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:04.950498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] RBAC: Authorizing `identity:get_user(user_id=465a8ad4220044b1ae2c472772b05ac7)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:04.951950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:04.954847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 162/315] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/users/465a8ad4220044b1ae2c472772b05ac7 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:04.961166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:05.058714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:05.068517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb3d4-bd04-4f83-94be-b2bbb8291bc6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:05.119120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:05.119120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:05.119120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:05.119120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:05.177422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:05.178925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:05.280320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 154/316] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:05.286646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:05.397872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176fde0-df4c-4eea-8d73-7b9dde6c8060 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:05.430087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:05.433503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731eb4-c145-4f41-95a4-31f788356f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:05.434380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731eb4-c145-4f41-95a4-31f788356f8b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:05.434656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731eb4-c145-4f41-95a4-31f788356f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:05.434924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731eb4-c145-4f41-95a4-31f788356f8b None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:05.436223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731eb4-c145-4f41-95a4-31f788356f8b None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:05.437664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731eb4-c145-4f41-95a4-31f788356f8b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:05.439810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 163/317] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:05 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:05.446391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:05.549087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f9564-d02d-4cc0-9903-69a9a3b325a4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:05.588396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:05.589110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:05.589394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:05.589668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:05.590502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] RBAC: Adding query filter params (role.id=647e539bfe0f42ad9807d586f74cffe6, scope.project.id=56677e6f8c3649888934255bb9b49b87, user.id=465a8ad4220044b1ae2c472772b05ac7) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:05.590813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:05.592275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581e34a-3362-469d-bb35-25c04ce61df2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:05.599401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 155/318] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:05 2022] GET /identity/v3/role_assignments?user.id=465a8ad4220044b1ae2c472772b05ac7&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=647e539bfe0f42ad9807d586f74cffe6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:06.480959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7a6d-36d8-4fdf-8b30-0ab8d708de2b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:06.481478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7a6d-36d8-4fdf-8b30-0ab8d708de2b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:06.481478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7a6d-36d8-4fdf-8b30-0ab8d708de2b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:06.482822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 164/319] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:06.490238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd581a6-8c9a-4e0d-a83d-5d28a2de0672 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:06.490676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd581a6-8c9a-4e0d-a83d-5d28a2de0672 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:06.490852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd581a6-8c9a-4e0d-a83d-5d28a2de0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:06.507840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3bd581a6-8c9a-4e0d-a83d-5d28a2de0672 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:06.509072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3bd581a6-8c9a-4e0d-a83d-5d28a2de0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:06.578955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:06.595392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 156/320] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:06.619356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7a6d-36d8-4fdf-8b30-0ab8d708de2b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:06.623212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:06.724802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7a6d-36d8-4fdf-8b30-0ab8d708de2b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:06.747633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3596b7-a1dc-485d-a089-34c3f19d3d4c None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:06.747833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3596b7-a1dc-485d-a089-34c3f19d3d4c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:06.748155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3596b7-a1dc-485d-a089-34c3f19d3d4c None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:06.749718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 157/321] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:27:06.755494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:06.755785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:06.756086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:06.763029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:06.763821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:06.764124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:06.764400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:06.765579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:06.767014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:06.769384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 165/322] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:06.773952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:06.774733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:06.775092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:06.845903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 158/323] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:06.850294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:06.869715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:06.882699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54249e-2215-4022-bf4e-9c0fd41cc5dc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:06.925990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede80f-e8e4-4cca-a37b-9539181d7f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:06.926664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede80f-e8e4-4cca-a37b-9539181d7f9b None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:06.926945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede80f-e8e4-4cca-a37b-9539181d7f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:06.927218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede80f-e8e4-4cca-a37b-9539181d7f9b None admin] PATH_INFO: `/v3/groups` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:06.927909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede80f-e8e4-4cca-a37b-9539181d7f9b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:06.929386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede80f-e8e4-4cca-a37b-9539181d7f9b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:06.974123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16ef01-e1a9-415c-800c-109cbb3652b3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:06.991199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:07.009958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.010717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.011061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.011341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.021700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:07.028945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 166/324] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jun 8 13:27:06 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:07.036005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:07.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 159/325] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:07.038131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.040910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9dde6-81df-49c2-b832-1567eee3f749 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.041206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9dde6-81df-49c2-b832-1567eee3f749 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.041490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9dde6-81df-49c2-b832-1567eee3f749 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.042907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 167/326] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:07.048958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.049881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.050773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.070055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:07.071264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:07.156250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 168/327] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:07.160186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc19c2-c0be-4306-b811-0b9f0ee75c5e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.178386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.202927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.203661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.203937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.204202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.204971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:07.205307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:07.206826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:07.216799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 160/328] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:07.223110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.251449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:07.271974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:07.298033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae448f2-294c-4814-a210-f60cad4ad3fe None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.340171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.341315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.341315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.341605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.351993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4e909-1447-4162-b0fb-009269259b79 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.360450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:07.369811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:07.370726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:07.371525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 169/329] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:07.376997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.410186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.411081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.411357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.411628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] PATH_INFO: `/v3/users/ece4418d314b40638bfeb77e5f4bf7d1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.413101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] RBAC: Authorizing `identity:get_user(user_id=ece4418d314b40638bfeb77e5f4bf7d1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:07.414546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:07.422792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 161/330] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:07 2022] GET /identity/v3/users/ece4418d314b40638bfeb77e5f4bf7d1 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:07.425488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.502696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd7b4b-4875-4e6f-a47a-9d470b69834d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.528147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:07.543173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.544213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.544213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.544460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.545228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:07.545536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:07.546949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:07.547211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7cc1-c87f-4ea9-93f3-b5d33f167b1b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.558393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 170/331] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:07.561396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:07.564010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.604361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.605038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.605319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.605594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.606432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] RBAC: Adding query filter params (role.id=b6aee05490564ee3847a4e359279b54f, user.id=ece4418d314b40638bfeb77e5f4bf7d1, scope.system=all) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:07.606746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:07.608203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:07.622279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 162/332] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 8 13:27:07 2022] GET /identity/v3/role_assignments?user.id=ece4418d314b40638bfeb77e5f4bf7d1&scope.system=all&role.id=b6aee05490564ee3847a4e359279b54f => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:07.703078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74b733-4d73-4314-b4be-150b078870b6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.743019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccd5b-9ec6-4567-9e64-db0b9adec1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.743921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccd5b-9ec6-4567-9e64-db0b9adec1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.744233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccd5b-9ec6-4567-9e64-db0b9adec1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.744504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccd5b-9ec6-4567-9e64-db0b9adec1c3 None admin] PATH_INFO: `/v3/users/02a5b53a33194e2fb3c024b13c747798` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.745813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccd5b-9ec6-4567-9e64-db0b9adec1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=02a5b53a33194e2fb3c024b13c747798)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:07.747285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccd5b-9ec6-4567-9e64-db0b9adec1c3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:07.749504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 171/333] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:07 2022] GET /identity/v3/users/02a5b53a33194e2fb3c024b13c747798 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:07.755171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:07.874382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14025-9793-43ab-9d65-99456ca5f5d4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:07.916681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788c59-8b7b-4c4a-993f-576c9f4675ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:07.917549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788c59-8b7b-4c4a-993f-576c9f4675ea None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:07.917827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788c59-8b7b-4c4a-993f-576c9f4675ea None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:07.918098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788c59-8b7b-4c4a-993f-576c9f4675ea None admin] PATH_INFO: `/v3/system/users/02a5b53a33194e2fb3c024b13c747798/roles/647e539bfe0f42ad9807d586f74cffe6` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:07.919672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788c59-8b7b-4c4a-993f-576c9f4675ea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02a5b53a33194e2fb3c024b13c747798, role_id=647e539bfe0f42ad9807d586f74cffe6)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:07.921166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788c59-8b7b-4c4a-993f-576c9f4675ea None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:08.023542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 163/334] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jun 8 13:27:07 2022] PUT /identity/v3/system/users/02a5b53a33194e2fb3c024b13c747798/roles/647e539bfe0f42ad9807d586f74cffe6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:27:09.926546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cdd83-df37-4797-b7b8-15b6ca41998a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:09.927545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cdd83-df37-4797-b7b8-15b6ca41998a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:09.928044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cdd83-df37-4797-b7b8-15b6ca41998a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:09.929937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 172/335] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:09.935867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:09.936759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:09.937256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:09.961594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:09.963150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:09.995872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:10.055792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f6c15-2ac4-4c55-b11b-073f9f95936d None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.056459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f6c15-2ac4-4c55-b11b-073f9f95936d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.056957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f6c15-2ac4-4c55-b11b-073f9f95936d None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.058518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 173/336] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:27:10.062164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 164/337] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:10.064144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.064582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.064854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.108085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:10.109304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:10.125702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:10.208158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:10.233729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 174/338] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:10.277587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:10.342414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca222028-929c-4cfd-bb63-1b772b26242a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:10.442382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d291-844b-4eca-9e54-eaa09d1788a1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:10.445287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:10.446110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.446394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.446673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.477094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:10.484891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:10.485785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:10.486811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:10.490932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 165/339] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:10.492027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:10.498903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:10.500658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.500934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.501210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.523359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:10.536296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:10.547790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:10.549275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:10.550070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 175/340] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:10.557028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:10.615972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb58a8-4769-49ed-bd55-e1bd138d5703 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:10.631875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:10.661274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:10.661953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.662233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.662507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.663252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:10.663554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:10.665230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:10.689997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 166/341] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:10.696283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:10.772882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ebf4-45c2-48a4-832b-f4dfc9fb6eeb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:10.857000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:10.857678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.857958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.858230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.858977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:10.859279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:10.862793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8f47-fc36-430c-b8dc-8d81bb5883ff None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:10.887593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 176/342] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:10.889167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce72d-426c-4ce7-ba48-32dc569bb262 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.889464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce72d-426c-4ce7-ba48-32dc569bb262 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.892078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce72d-426c-4ce7-ba48-32dc569bb262 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:10.892078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 177/343] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:10.897125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ce72d-426c-4ce7-ba48-32dc569bb262 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:10.899566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:10.923986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb20d0c-e9db-4124-bde2-2a7001a8fcd0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:10.989416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02670be-d630-49b6-8242-b2a984897319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:10.990835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02670be-d630-49b6-8242-b2a984897319 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:10.991278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02670be-d630-49b6-8242-b2a984897319 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:10.991694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02670be-d630-49b6-8242-b2a984897319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.050365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ce72d-426c-4ce7-ba48-32dc569bb262 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:11.054147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:11.087348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02670be-d630-49b6-8242-b2a984897319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:11.089145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02670be-d630-49b6-8242-b2a984897319 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:11.107824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:11.110229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.110229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.110229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.182964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:11.204192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 167/344] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:11.205796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.206238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.206711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.228518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:11.249184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:11.275474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:11.276989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:11.342051 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 168/345] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:11.343929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:11.489391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae76dc-22f8-44b4-9d98-3976918a8b79 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:11.491553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 178/346] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:11.492617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:11.495847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:11.506407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:11.532647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e1a54-5204-4cbb-a359-64576ff9e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:11.534455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1a54-5204-4cbb-a359-64576ff9e103 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.534974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1a54-5204-4cbb-a359-64576ff9e103 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.535414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1a54-5204-4cbb-a359-64576ff9e103 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.536858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1a54-5204-4cbb-a359-64576ff9e103 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:11.538193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1a54-5204-4cbb-a359-64576ff9e103 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:11.540533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 169/347] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:11 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:11.541790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f04c-52eb-48f9-af7b-e2a5ac19e02f None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.542079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f04c-52eb-48f9-af7b-e2a5ac19e02f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.542360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f04c-52eb-48f9-af7b-e2a5ac19e02f None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.543872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 170/348] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:11.544630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f04c-52eb-48f9-af7b-e2a5ac19e02f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:11.622397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece850a6-ef4a-41af-b280-e05469b3b20a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:11.670262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:11.671569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.671856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.672158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.673108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f04c-52eb-48f9-af7b-e2a5ac19e02f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:11.687078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:11.697012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:11.697982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 179/349] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:11.699409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:11.719023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045696c8-8c25-478b-8309-c2bdcd55d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:11.720374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045696c8-8c25-478b-8309-c2bdcd55d070 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.721419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045696c8-8c25-478b-8309-c2bdcd55d070 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.722091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045696c8-8c25-478b-8309-c2bdcd55d070 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.723983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045696c8-8c25-478b-8309-c2bdcd55d070 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:11.725521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045696c8-8c25-478b-8309-c2bdcd55d070 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:11.727973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 171/350] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:11 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:11.728991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.729284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.729561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.750504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:11.752316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:11.795175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:11.821469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:11.849930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3f27-c0d6-43ce-90ef-ec902ffd071a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:11.855494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 172/351] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:11.856463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:11.891728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37291b-8792-4fb6-8f4c-780d1dd6cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:11.892606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37291b-8792-4fb6-8f4c-780d1dd6cde1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.892886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37291b-8792-4fb6-8f4c-780d1dd6cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.893159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37291b-8792-4fb6-8f4c-780d1dd6cde1 None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.900620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37291b-8792-4fb6-8f4c-780d1dd6cde1 None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:11.902066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37291b-8792-4fb6-8f4c-780d1dd6cde1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:11.903770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 180/352] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:11 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:11.905746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4bc0-db98-47c3-abba-081c81b01e97 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:11.906032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4bc0-db98-47c3-abba-081c81b01e97 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:11.906308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4bc0-db98-47c3-abba-081c81b01e97 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:11.907684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 181/353] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:11.909355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc4bc0-db98-47c3-abba-081c81b01e97 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:11.999461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffcb9-44c2-4eb4-a1f2-a0c747f42ed1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.042266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.042929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.043208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.043442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.044300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:12.044511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:12.045890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:12.052765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc4bc0-db98-47c3-abba-081c81b01e97 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.056413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 173/354] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:12.057236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.089951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:12.106786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.107673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.107962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.108263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.109494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:12.111581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:12.112411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:12.113503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 182/355] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:11 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:12.114282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.188746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4a12-92ad-49ea-836a-0e3500e7aefe None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.231260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e901e-8637-414a-af75-98ebacfd536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.232176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e901e-8637-414a-af75-98ebacfd536e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.232370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e901e-8637-414a-af75-98ebacfd536e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.232635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e901e-8637-414a-af75-98ebacfd536e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.240185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124b768-9928-4be5-b98c-1291b234e23a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.245442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e901e-8637-414a-af75-98ebacfd536e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-840e901e-8637-414a-af75-98ebacfd536e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:12.254053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:12.254940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:12.255733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 174/356] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:12.256623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.256915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.257198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.275789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:12.277043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:12.286630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.287305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.287589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.287874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.288776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=c7e75612da3942be997ad038eadd12c5) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:12.289092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:12.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:12.297919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 183/357] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=b6aee05490564ee3847a4e359279b54f => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:12.298251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.382584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:12.382916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 175/358] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:12.384609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.423475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:12.437156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015c5f6-ede3-44fb-9888-e0942c49c527 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.485409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.485409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.485409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.485409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.522082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaac2e-b1a9-4160-a445-7e52134e75d6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.565251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.565900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.566183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.566461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.567297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=c7e75612da3942be997ad038eadd12c5) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:12.567598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:12.569061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b421f-cbbc-4498-8c12-ba92e75ea48d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:12.575141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:12.575720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 176/359] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:12.576864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7abe-47f5-4d3d-8da6-b637e48e42c8 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.576989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:12.577154 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7abe-47f5-4d3d-8da6-b637e48e42c8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.577416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7abe-47f5-4d3d-8da6-b637e48e42c8 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.578823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 177/360] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:12.579401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7abe-47f5-4d3d-8da6-b637e48e42c8 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.650983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:12.704170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 184/361] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:12.705961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.733753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:12.745950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7abe-47f5-4d3d-8da6-b637e48e42c8 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.793451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.794509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.794821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.795646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.796763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:12.797075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:12.800387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb5d5-0a9c-484e-9374-03d8881016b1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:12.812466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 178/362] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:12.813595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.813883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.814294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.833920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:12.835120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:12.847654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52be3-de7c-4224-9bf8-5bcf3c0f22b0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:12.907057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:12.909218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:12.909727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:12.910198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:12.922564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 179/363] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:12.923202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.926569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:12.938051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:12.938952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:12.940714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:12.948334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 185/364] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:12.948334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:12.986757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.050066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.068032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4021-f16d-43b8-b507-4ab68bc1ab63 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.083185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a766d-05f3-473c-866a-a05ec994360d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.117422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.118462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.118745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.119014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.120219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.121865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.123722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 180/365] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:13.126123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.126463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.127609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.127864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.129222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] PATH_INFO: `/v3/users/02a5b53a33194e2fb3c024b13c747798` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.130682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] RBAC: Authorizing `identity:get_user(user_id=02a5b53a33194e2fb3c024b13c747798)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.132329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.134001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 186/366] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:27:12 2022] GET /identity/v3/users/02a5b53a33194e2fb3c024b13c747798 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:13.134835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.262532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.264248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca644c0-ae54-4c47-a8ac-1bc52d46203b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.276777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae373bd-d341-445a-8e6e-f746535da580 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.302691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.303280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.303607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.303827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.304600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:13.304901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.306261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.319140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342391a3-db04-4561-859f-4c9641452639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.319659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 181/367] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:13.320526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.320832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342391a3-db04-4561-859f-4c9641452639 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.321262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342391a3-db04-4561-859f-4c9641452639 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.321669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342391a3-db04-4561-859f-4c9641452639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.336172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342391a3-db04-4561-859f-4c9641452639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:13.339160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-342391a3-db04-4561-859f-4c9641452639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:13.347572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:13.349005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:13.350015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:13.352971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 187/368] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:13.353910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342391a3-db04-4561-859f-4c9641452639 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.446335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04c536-73bb-4cb2-9748-cba1e986bfac None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.483043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342391a3-db04-4561-859f-4c9641452639 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.484261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.485241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.485619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.488374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.489782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.491932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.493512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 182/369] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:13.494375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.531661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.533975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.534369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.534648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.535473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] RBAC: Adding query filter params (role.id=647e539bfe0f42ad9807d586f74cffe6, user.id=02a5b53a33194e2fb3c024b13c747798, scope.system=all) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:13.535785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.537266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.551265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 188/370] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/role_assignments?user.id=02a5b53a33194e2fb3c024b13c747798&scope.system=all&role.id=647e539bfe0f42ad9807d586f74cffe6 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:13.552135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.568593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.606982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.631143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009caba-0b7b-45b6-9b3e-1239e384c77d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.675318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.676173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.677019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.677409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.762393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.764239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.771924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0f5c0-8f2a-4d89-9000-1ae42bc040d2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:13.844954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:13.845959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:13.846455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:13.846889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:13.847880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:13.848359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:13.849998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:13.866206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:13.869385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 189/371] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:13.870394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:13.889146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 183/372] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:13.890182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.024559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeb6ed-4300-4654-9229-ddc7c32dcdba None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.024759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:14.074750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1b8bb-a1bf-4398-b934-a525a1c50bf7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.085987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.087227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.087633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.088030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.136993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.138380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.139171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.140690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.141776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=56677e6f8c3649888934255bb9b49b87) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:14.142887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.144618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.153081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 190/373] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=b6aee05490564ee3847a4e359279b54f => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:14.154227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.169601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:14.217149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.218679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.287656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e993b65-1b60-4d13-a5bb-62c4e1ffd820 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.326324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:14.333835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.335362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.335848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.336454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.338225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.339986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.342478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 191/374] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:14 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:14.349304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.449132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 184/375] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:14.457221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.517661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8885-0723-4be9-a5f9-2e4c489eacf9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.564257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.565141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.565426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.565697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.567449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.569399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.572118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 192/376] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:14 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:14.577808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.579217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:14.600479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00a08c-1e60-4b22-a311-d139fe936a72 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.639522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.640437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.640765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.641161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] PATH_INFO: `/v3/projects/2c9b429555f24abe8bf7e676e75bbda4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.642541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] RBAC: Authorizing `identity:get_project(project_id=2c9b429555f24abe8bf7e676e75bbda4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.644248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.646364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 185/377] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:14 2022] GET /identity/v3/projects/2c9b429555f24abe8bf7e676e75bbda4 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:14.652362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.703295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:14.768938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a3123-ef52-4486-92c8-9cd61ff8cafc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.773165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd532-a19a-4a89-83b6-16b405ac9f39 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.812906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.814283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.814582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.814854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] PATH_INFO: `/v3/groups/114216087d774788bf00817f9de6d313` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.822514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] RBAC: Authorizing `identity:get_group(group_id=114216087d774788bf00817f9de6d313)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.823976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.826470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 186/378] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:14 2022] GET /identity/v3/groups/114216087d774788bf00817f9de6d313 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:14.832875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:14.843723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.844466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.844749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.845531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.846485 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=56677e6f8c3649888934255bb9b49b87) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:14.846801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.848462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5021b1-befd-480b-bb85-265dda16b592 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:14.853691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:14.858193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 193/379] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:14 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:14.952172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c0e02-347c-4e28-b841-8bb90caab33f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:14.991486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:14.992193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:14.992475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:14.992751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:14.993602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] RBAC: Adding query filter params (group.id=114216087d774788bf00817f9de6d313, role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=2c9b429555f24abe8bf7e676e75bbda4) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:14.993914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:14.995395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a0ec-37cc-41bb-954d-9804dfce70de None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:15.002841 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 187/380] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:14 2022] GET /identity/v3/role_assignments?group.id=114216087d774788bf00817f9de6d313&scope.project.id=2c9b429555f24abe8bf7e676e75bbda4&role.id=06c074382d5e4a2893d59028af60fee8 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:15.121975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc13fe-03d6-4096-b933-a37069f4c3f9 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.122260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc13fe-03d6-4096-b933-a37069f4c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.122443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc13fe-03d6-4096-b933-a37069f4c3f9 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.124162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 194/381] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:15.130337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258e81-0a65-40f7-aaba-5354d9f9d5a7 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.131310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258e81-0a65-40f7-aaba-5354d9f9d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.131784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258e81-0a65-40f7-aaba-5354d9f9d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.152915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d0258e81-0a65-40f7-aaba-5354d9f9d5a7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:15.154494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d0258e81-0a65-40f7-aaba-5354d9f9d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:15.232263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 188/382] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:15.256298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc13fe-03d6-4096-b933-a37069f4c3f9 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:15.350562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7f639-cd04-4baf-91e3-29903574e929 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.350902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7f639-cd04-4baf-91e3-29903574e929 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.351112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7f639-cd04-4baf-91e3-29903574e929 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.352770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 189/383] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:15.365720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.366318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.366806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.379834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc13fe-03d6-4096-b933-a37069f4c3f9 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:15.401165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:15.402740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:15.405235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:15.413962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:15.419484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:15.428691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.428691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.428691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.432710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:15.441286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:15.442411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:15.443407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:15.445326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 195/384] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:15.452554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:15.528178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 190/385] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:15.553896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:15.630258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03484-1dd1-4ad7-831b-59e92085597e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:15.668990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:15.670016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.670496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.670967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.671948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:15.674364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:15.676151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:15.685585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 196/386] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:15.693108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:15.714023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a90f1-0ae5-4f05-85f2-0a83980e5e58 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:15.759350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:15.811593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f2d9a-735e-41a9-836e-0f36b3a9ffdd None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:15.812762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:15.813866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.814309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.814894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.839990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:15.849681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:15.850426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:15.850942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:15.857870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:15.857870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:15.857870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:15.857870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:15.857870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 197/387] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:15 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:15.858999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:15.859825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:15.861189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:15.868355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 191/388] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:15.869432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:15.874007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:15.994756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c387df-9123-49cd-ac95-13dd596b4f22 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:16.020760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:16.033715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:16.034925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:16.035382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:16.035845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:16.037256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:16.039088 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:16.042197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 198/389] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:15 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:16.049185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:16.100383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be795-1c8c-486d-83db-3d5748dd318e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:16.151491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:16.153453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:16.153939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:16.154441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:16.155388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:16.155894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:16.157549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:16.172322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 192/390] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:16.174882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:16.247346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:16.261275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f820d-8fff-4431-9374-7ddcd6a99eef None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:16.337407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9591cd4-251a-4117-a495-2c8fd860c47e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:16.338399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:16.339553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:16.340031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:16.342205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:16.345533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e75612da3942be997ad038eadd12c5, group_id=dc398d15f3374b4fb07cc21e5e82c6eb, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:16.353006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:16.385819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:16.387039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:16.387589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:16.388080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:16.389463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:16.391194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:16.397661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 193/391] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:16 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:16.399055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:16.427718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 199/392] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 8 13:27:16 2022] PUT /identity/v3/projects/c7e75612da3942be997ad038eadd12c5/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:27:16.521131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588215b0-8a5f-4b44-b6de-60cfd30c45fb None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:16.552993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:16.561132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740740c-e0fa-4cde-9135-c5500a905272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:16.563945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740740c-e0fa-4cde-9135-c5500a905272 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:16.563945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740740c-e0fa-4cde-9135-c5500a905272 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:16.563945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740740c-e0fa-4cde-9135-c5500a905272 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:16.564206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740740c-e0fa-4cde-9135-c5500a905272 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:16.565594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740740c-e0fa-4cde-9135-c5500a905272 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:16.572320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 194/393] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:16 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:16.573791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:16.657084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:16.724793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c80b13-ca74-4f85-8ef9-a925562b71fa None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:16.761569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf7c02-9cee-4302-9039-94e624399ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:16.762463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf7c02-9cee-4302-9039-94e624399ea2 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:16.762744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf7c02-9cee-4302-9039-94e624399ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:16.763018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf7c02-9cee-4302-9039-94e624399ea2 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:16.765271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf7c02-9cee-4302-9039-94e624399ea2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e75612da3942be997ad038eadd12c5, group_id=dc398d15f3374b4fb07cc21e5e82c6eb, role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:16.767263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf7c02-9cee-4302-9039-94e624399ea2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:16.828263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 200/394] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 8 13:27:16 2022] PUT /identity/v3/projects/c7e75612da3942be997ad038eadd12c5/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:17.389103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d321-b7a4-48ee-bf18-f78bf96e4b8d None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:17.389602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d321-b7a4-48ee-bf18-f78bf96e4b8d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:17.389602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d321-b7a4-48ee-bf18-f78bf96e4b8d None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:17.390938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 195/395] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:17.397669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070d22b-84ee-4578-ae99-e23043e71d16 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:17.398152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070d22b-84ee-4578-ae99-e23043e71d16 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:17.398227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070d22b-84ee-4578-ae99-e23043e71d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:17.425281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f070d22b-84ee-4578-ae99-e23043e71d16 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:17.426516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f070d22b-84ee-4578-ae99-e23043e71d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:17.522579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 201/396] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:17.558316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d321-b7a4-48ee-bf18-f78bf96e4b8d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:17.698501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4247122-f205-4f23-be49-f7f711405751 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:17.699172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4247122-f205-4f23-be49-f7f711405751 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:17.699668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4247122-f205-4f23-be49-f7f711405751 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:17.701811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 202/397] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:17.705301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d321-b7a4-48ee-bf18-f78bf96e4b8d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:17.713412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:17.714002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:17.714468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:17.745229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:17.746315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:17.746487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:17.747004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:17.747424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:17.747957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:17.760665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:17.769478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:17.770384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:17.771190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:17.773987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 196/398] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:17.784964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:17.809429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:17.848791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 203/399] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:17.870307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:17.891527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:17.950110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108eb40-da86-40cd-8d90-a6ffae8c4b94 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:17.986558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:17.987526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:17.987811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:17.988105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:17.989033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:17.989723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:17.991352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.012947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 197/400] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:18.019265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.034952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1407ecf-f2af-4803-9c3e-47334e2d51c6 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.080499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12bad-3d7d-437a-a195-4b160d108af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.081318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12bad-3d7d-437a-a195-4b160d108af5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.081599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12bad-3d7d-437a-a195-4b160d108af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.081875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12bad-3d7d-437a-a195-4b160d108af5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.094931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d12bad-3d7d-437a-a195-4b160d108af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-46d12bad-3d7d-437a-a195-4b160d108af5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:18.103906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:18.104846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:18.105647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 204/401] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:18.106722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002957ad-2eaa-4b38-ad1b-b4f64308b397 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.106722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002957ad-2eaa-4b38-ad1b-b4f64308b397 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.107027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002957ad-2eaa-4b38-ad1b-b4f64308b397 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.112162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 205/402] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:18.113719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002957ad-2eaa-4b38-ad1b-b4f64308b397 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.149035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.178784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630722b-7d76-4617-a2df-f4ba1d0338e0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.200705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.220364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a679-16c3-4998-8dcc-3289c9bed43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.222457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a679-16c3-4998-8dcc-3289c9bed43c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.223027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a679-16c3-4998-8dcc-3289c9bed43c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.223602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a679-16c3-4998-8dcc-3289c9bed43c None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.225047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a679-16c3-4998-8dcc-3289c9bed43c None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:18.226933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a679-16c3-4998-8dcc-3289c9bed43c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.229221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 198/403] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:18.230636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.231141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.231793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.234907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002957ad-2eaa-4b38-ad1b-b4f64308b397 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.257922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:18.259534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:18.270815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.271532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.271761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.272037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.272822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:18.273132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:18.274515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.283134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 206/404] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:18.283974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.348386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 199/405] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:18.350448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.388464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.396983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f674ad-f0aa-410f-a081-2ddefdbbc877 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.434373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.435452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.435798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.436278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.437578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:18.439875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.446721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 207/406] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:18.447710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.476545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc53eb-3518-4032-86fe-d7fee4ab5a2e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.494404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.514385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.515644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.516201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.516770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.518240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:18.519882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.522046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 200/407] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:18.523076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.559018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4a1f-a35b-4f83-b0fa-53f4a1077349 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.598277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.599079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.599375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.599892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.613878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:18.624300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:18.625201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:18.626585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 208/408] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:18.627249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.650289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae0b79-3fd7-488a-8d3f-28ed58225212 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.661759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.689060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.690535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.691087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.691619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.694023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] RBAC: Authorizing `identity:create_grant(project_id=56677e6f8c3649888934255bb9b49b87, group_id=dc398d15f3374b4fb07cc21e5e82c6eb, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:18.695733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.758508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aff37-d2a1-4ac2-883a-2398f5c3ded9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.795433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 201/409] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 8 13:27:18 2022] PUT /identity/v3/projects/56677e6f8c3649888934255bb9b49b87/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:18.796610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.797027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.797650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.798168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.799052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.800409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:18.804020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:18.804764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 209/410] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:18.817015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:18.862159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.945740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155c70-272d-4903-b9d3-33f1c21fb586 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:18.994814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:18.996220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:18.997777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:18.998314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:18.998795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:18.999770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:19.000320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:19.002408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:19.013565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 202/411] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:19.017407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ba45-dc6b-4a19-9e23-1d93da8bdd67 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.020711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:19.062299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:19.063476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.063915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.064234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.066986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] RBAC: Authorizing `identity:create_grant(project_id=56677e6f8c3649888934255bb9b49b87, group_id=dc398d15f3374b4fb07cc21e5e82c6eb, role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:19.068923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:19.142428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 210/412] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 8 13:27:18 2022] PUT /identity/v3/projects/56677e6f8c3649888934255bb9b49b87/groups/dc398d15f3374b4fb07cc21e5e82c6eb/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:19.166521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ee9bd-e62b-4b97-8298-d2c7bab40639 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.175362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:19.213185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:19.214081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.214363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.214638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] PATH_INFO: `/v3/groups/114216087d774788bf00817f9de6d313` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.216011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] RBAC: Authorizing `identity:get_group(group_id=114216087d774788bf00817f9de6d313)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:19.217516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:19.220128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 203/413] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:19 2022] GET /identity/v3/groups/114216087d774788bf00817f9de6d313 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:19.226592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:19.367687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905754b-458b-489d-b534-eca34e6d5e0c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.406207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae89f0-7da7-4b99-8657-1e773f7efb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:19.408526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae89f0-7da7-4b99-8657-1e773f7efb47 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.408821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae89f0-7da7-4b99-8657-1e773f7efb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.409102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae89f0-7da7-4b99-8657-1e773f7efb47 None admin] PATH_INFO: `/v3/projects/2c9b429555f24abe8bf7e676e75bbda4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.410430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae89f0-7da7-4b99-8657-1e773f7efb47 None admin] RBAC: Authorizing `identity:get_project(project_id=2c9b429555f24abe8bf7e676e75bbda4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:19.411923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae89f0-7da7-4b99-8657-1e773f7efb47 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:19.414064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 211/414] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:19 2022] GET /identity/v3/projects/2c9b429555f24abe8bf7e676e75bbda4 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:19.420045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:19.429251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c8b8a-8f8b-479c-90e6-56a86f8c7df3 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.429807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c8b8a-8f8b-479c-90e6-56a86f8c7df3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.430264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c8b8a-8f8b-479c-90e6-56a86f8c7df3 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.431807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 212/415] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:19.447186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471482e0-0c4b-4222-afca-0d64590e7174 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.448205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471482e0-0c4b-4222-afca-0d64590e7174 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.448692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471482e0-0c4b-4222-afca-0d64590e7174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.468437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-471482e0-0c4b-4222-afca-0d64590e7174 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:19.471155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-471482e0-0c4b-4222-afca-0d64590e7174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:19.508215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:19.536603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9eca1-7c7e-49a3-bc81-cf6a80052d6a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.558671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 213/416] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:19.560981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a391a-8036-49d1-9d53-51bb13463023 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.561270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a391a-8036-49d1-9d53-51bb13463023 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.561548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a391a-8036-49d1-9d53-51bb13463023 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.567653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 214/417] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:19.569358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.569698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.570045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.573855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:19.574737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.575020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.575288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] PATH_INFO: `/v3/projects/2c9b429555f24abe8bf7e676e75bbda4/groups/114216087d774788bf00817f9de6d313/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.580910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c9b429555f24abe8bf7e676e75bbda4, group_id=114216087d774788bf00817f9de6d313, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:19.582495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:19.588088 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:19.589253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:19.659518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 204/419] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 8 13:27:19 2022] PUT /identity/v3/projects/2c9b429555f24abe8bf7e676e75bbda4/groups/114216087d774788bf00817f9de6d313/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:19.659694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 215/419] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:19.660420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:19.684661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:19.700078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:19.785244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21cdbd-b2ec-42fa-8fb3-547430f9f6e9 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.829266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:19.830424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.830704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.830977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:19.844955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:19.846363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:19.854690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:19.865584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 205/420] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:19.866401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:19.901218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e99b51-423a-431d-af21-d1ab83c70ea3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.979958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:19.986338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d825a5-e812-478c-8d68-fa6a193aa76c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:19.998091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:19.999104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:19.999215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:19.999459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:20.011633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:20.021465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:20.022386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:20.023226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 216/421] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:20.028356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:20.037944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:20.038886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:20.039597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:20.040021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:20.040964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:20.041408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:20.042974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:20.055620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 206/422] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:20.064109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:20.197818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bbe99-7ed7-49dd-bb14-1724ed6458a5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:20.220261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52674-d388-4a60-a609-3b89776c073e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:20.259920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:20.260623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:20.260909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:20.261188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:20.285959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:20.286642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:20.286970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:20.287249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:20.287999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:20.289047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:20.292675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:20.300174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:20.316014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 217/423] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:20.320453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:20.320863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:20.434330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:20.435605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:20.465861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a0144-053f-4615-89fa-1e86c367c981 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:20.505099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:20.506763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:20.507882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:20.508395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:20.605475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 207/424] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:20.611863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:20.627904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:20.629853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:20.631333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:20.728426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:20.816689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da77a0-dfb4-4fa7-adc1-bd2aefb89240 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:20.832633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 218/425] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:20.841041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:20.860533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:20.861303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:20.861583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:20.861867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:20.863043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:20.870382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:20.870382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 208/426] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:20 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:20.872719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:21.026786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e019a7-0e98-4783-8bfd-9ff99e3fd6e6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:21.040315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:21.044368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac3288-5938-4ad3-863a-53499d56aae4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:21.078271 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:21.104000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:21.104898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.105175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.105442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.106914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:21.108375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:21.112831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 209/427] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:20 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:21.114274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:21.115150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.115426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.115694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] PATH_INFO: `/v3/projects/c7e75612da3942be997ad038eadd12c5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.117132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:21.118708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e75612da3942be997ad038eadd12c5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:21.120240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:21.135565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 219/428] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:20 2022] GET /identity/v3/projects/c7e75612da3942be997ad038eadd12c5 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:21.137365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:21.323382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77eb05-9537-443d-9955-53802b6936a5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:21.343378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7433fe-64e3-4ed7-84e4-4476021b1b85 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:21.390207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:21.390784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.391589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.391867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.392766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=c7e75612da3942be997ad038eadd12c5) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:21.393076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:21.394499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:21.410171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ce2a-13c8-475e-b032-93c9c1f0f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:21.411023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ce2a-13c8-475e-b032-93c9c1f0f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.411297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ce2a-13c8-475e-b032-93c9c1f0f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.411574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ce2a-13c8-475e-b032-93c9c1f0f0b0 None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.416961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ce2a-13c8-475e-b032-93c9c1f0f0b0 None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:21.418443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ce2a-13c8-475e-b032-93c9c1f0f0b0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:21.420528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 210/429] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:21 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=b6aee05490564ee3847a4e359279b54f => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:21.420752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 220/430] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:21 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:21.427129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:21.520443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:21.579541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496687-f0ce-49ad-9b58-7758a30c4e85 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.580603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496687-f0ce-49ad-9b58-7758a30c4e85 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.581105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496687-f0ce-49ad-9b58-7758a30c4e85 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.582770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 221/431] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:21.588745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023dfb-8fb2-492a-873c-0a13f60234ef None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.589468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023dfb-8fb2-492a-873c-0a13f60234ef None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.589981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023dfb-8fb2-492a-873c-0a13f60234ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.597592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a089e7b-533d-4ae4-8967-d0d816043db6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:21.642031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e3023dfb-8fb2-492a-873c-0a13f60234ef None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:21.643256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e3023dfb-8fb2-492a-873c-0a13f60234ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:21.650402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:21.651077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.651363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.651676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.652629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=c7e75612da3942be997ad038eadd12c5) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:21.652949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:21.654402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:21.662624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 211/432] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:21 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=c7e75612da3942be997ad038eadd12c5&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:21.705773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:21.761347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 222/433] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:21.786498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:21.917374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc1ac4-9930-47fe-9192-6f64feac31da None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:21.942951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:21.953344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aaf03-8a1e-4ab4-b162-4877d5441c15 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.953719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aaf03-8a1e-4ab4-b162-4877d5441c15 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.953969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aaf03-8a1e-4ab4-b162-4877d5441c15 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.955343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 223/434] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:27:21.962436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.962436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.962436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.965220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:21.966035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:21.966319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:21.966600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:21.980471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:21.987914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:21.989004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:21.990238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 212/435] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:21.991697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:21.993260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:21.995249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.082821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 224/436] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:22.105621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.127341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac00618-6c39-42ed-8104-c43394565114 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.167785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.168443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.168726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.169005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.169753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:22.170061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:22.171447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:22.182283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 213/437] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:22.187961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.225620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.232810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b925b-3752-47eb-8a03-8f373ecb3a24 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.254833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.289339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.290167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.290454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.290732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.307419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:22.316483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:22.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:22.318237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 225/438] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:22.323345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.325558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13164c57-1f77-4c40-9ac8-7fc19ed39ac1 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.376442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c542a-e061-42a7-8409-e771b57fcf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.377109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c542a-e061-42a7-8409-e771b57fcf19 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.377387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c542a-e061-42a7-8409-e771b57fcf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.377658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c542a-e061-42a7-8409-e771b57fcf19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.454732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cef20-a696-4e44-a01e-f74987d98208 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.462789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c542a-e061-42a7-8409-e771b57fcf19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:22.464588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c542a-e061-42a7-8409-e771b57fcf19 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:22.496712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.497386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.497663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.497933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.498673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:22.498976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:22.500482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557f8b-08db-46f3-a6e6-3452c51ca993 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:22.509586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 226/439] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:22.511904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88a78-70c5-450b-95d6-972f15a5b6ef None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.512220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88a78-70c5-450b-95d6-972f15a5b6ef None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.512493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88a78-70c5-450b-95d6-972f15a5b6ef None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.513766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 227/440] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:22.514586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.514968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab88a78-70c5-450b-95d6-972f15a5b6ef None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.534522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.581319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 214/441] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 13:27:22.581319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.581319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.581319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.595350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:22.596663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:22.620327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab88a78-70c5-450b-95d6-972f15a5b6ef None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.652835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.653473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.653752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.654027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.662486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 215/442] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:22.663318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.732577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.736352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:22.739988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:22.754533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.763076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b103202-7924-4ea7-9e9d-7cc46ad948f4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.798150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.799172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.799452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.799730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.800953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:22.802391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:22.804119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 216/443] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:22.804877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.840487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 228/444] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 13:27:22.840487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.909288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebb997-7791-41b7-8d8b-ed5d69521cf5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.934374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65904cb-5652-494a-8e72-c47b24345f4f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:22.943746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.944568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.944850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.945125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.951102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.952979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:22.956099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:22.963743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:22.964664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 217/445] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:22.965737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:22.970087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:22.971232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:22.971518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:22.971902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:22.973126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:22.974592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:22.976252 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 229/446] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:22.977006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.066801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dea14-1986-48c1-bdc8-f3efc0528c28 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.078562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605150be-9beb-4a44-b67d-c5e6e27d000a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.101813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.102676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.102953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.103230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] PATH_INFO: `/v3/projects/56677e6f8c3649888934255bb9b49b87` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.104436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] RBAC: Authorizing `identity:get_project(project_id=56677e6f8c3649888934255bb9b49b87)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.105873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.107547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 218/447] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/projects/56677e6f8c3649888934255bb9b49b87 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.108315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.113449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.114105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.114381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.114649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.115381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:23.115680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.117072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.126121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 230/448] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.126734 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.172346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:23.174232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:23.207150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747815d-e6c0-4483-8914-00bc4edbc670 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.225071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98398e-b18d-4b28-a2b2-fabbd342e7bb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.239208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.239937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.240272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.240611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.241391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=b6aee05490564ee3847a4e359279b54f, scope.project.id=56677e6f8c3649888934255bb9b49b87) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:23.241706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.243128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.249591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 219/449] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=b6aee05490564ee3847a4e359279b54f => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.251015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.264203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.264203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.264203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.264203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] PATH_INFO: `/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.264588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] RBAC: Authorizing `identity:get_group(group_id=dc398d15f3374b4fb07cc21e5e82c6eb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.264588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.267655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 231/450] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/groups/dc398d15f3374b4fb07cc21e5e82c6eb => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.274091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.366311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8499649-bd38-4261-ad12-bd3ed1a4667e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.397398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6586d-3948-428d-b38e-5419274eb93e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.399397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:23.404464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.405137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.405423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.405700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.415165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:23.438096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.438807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.439164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.439441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.440338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] RBAC: Adding query filter params (group.id=dc398d15f3374b4fb07cc21e5e82c6eb, role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=56677e6f8c3649888934255bb9b49b87) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:23.440647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.442095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.449884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 232/451] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/role_assignments?group.id=dc398d15f3374b4fb07cc21e5e82c6eb&scope.project.id=56677e6f8c3649888934255bb9b49b87&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.492378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.493868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.615360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 220/452] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:23.620913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.732326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214632be-6a5f-438f-ab42-51b1ae68b3a1 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.769728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.770595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.770879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.771154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] PATH_INFO: `/v3/projects/2c9b429555f24abe8bf7e676e75bbda4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.772375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2c9b429555f24abe8bf7e676e75bbda4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.773860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.775557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 233/453] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/projects/2c9b429555f24abe8bf7e676e75bbda4 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.781339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.814259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:23.883960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92502e9-002d-450d-8f9e-7b4ffc22af12 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:23.918101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea59ad-be52-410f-b311-ba6fc98fb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:23.918955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea59ad-be52-410f-b311-ba6fc98fb96c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:23.919240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea59ad-be52-410f-b311-ba6fc98fb96c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:23.919519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea59ad-be52-410f-b311-ba6fc98fb96c None admin] PATH_INFO: `/v3/groups/114216087d774788bf00817f9de6d313` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:23.920686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea59ad-be52-410f-b311-ba6fc98fb96c None admin] RBAC: Authorizing `identity:get_group(group_id=114216087d774788bf00817f9de6d313)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:23.922220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea59ad-be52-410f-b311-ba6fc98fb96c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:23.924034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 221/454] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/groups/114216087d774788bf00817f9de6d313 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:23.929879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:23.976611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:24.029293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053864-2d64-40ba-886c-532a3a9b62b2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:24.062212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:24.063609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:24.063977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:24.064287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:24.065112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] RBAC: Adding query filter params (group.id=114216087d774788bf00817f9de6d313, role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=2c9b429555f24abe8bf7e676e75bbda4) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:24.065424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:24.066853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5975440-aa63-4a29-9ddc-9db14aee05f9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:24.072555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 234/455] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 8 13:27:23 2022] GET /identity/v3/role_assignments?group.id=114216087d774788bf00817f9de6d313&scope.project.id=2c9b429555f24abe8bf7e676e75bbda4&role.id=06c074382d5e4a2893d59028af60fee8 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:26.706199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc634f6-c5a2-4992-a75f-e140a938d2b0 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:26.707205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc634f6-c5a2-4992-a75f-e140a938d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:26.707654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc634f6-c5a2-4992-a75f-e140a938d2b0 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:26.709482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 222/456] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:26.714736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e7c15-0914-4575-97ad-6216bbf593e8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:26.715157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e7c15-0914-4575-97ad-6216bbf593e8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:26.715283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e7c15-0914-4575-97ad-6216bbf593e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:26.741078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fb9e7c15-0914-4575-97ad-6216bbf593e8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:26.742264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fb9e7c15-0914-4575-97ad-6216bbf593e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:26.830291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 235/457] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:26.865949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc634f6-c5a2-4992-a75f-e140a938d2b0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:26.878449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4261-86fb-4ebe-a5b6-6d38299e8a0d None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:26.878983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4261-86fb-4ebe-a5b6-6d38299e8a0d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:26.879411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4261-86fb-4ebe-a5b6-6d38299e8a0d None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:26.881222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 236/458] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:26.886457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:26.886902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:26.887343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:26.913098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:26.915439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:26.990064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:27.048421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:27.054612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc634f6-c5a2-4992-a75f-e140a938d2b0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:27.058560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 237/459] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:27.096583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:27.110976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:27.111795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.112095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.112377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.123589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:27.126429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:27.146007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:27.146973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:27.147823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:27.147823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:27.147823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:27.147823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:27.150052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 223/460] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:27.155732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:27.269866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07d03-a472-4b44-a136-7e13cd010c97 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:27.314111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:27.315137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.315597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.316046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.317086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:27.317596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:27.319141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:27.328497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222447a-2b59-48b7-ac6c-05ad4b657d62 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:27.333227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 224/461] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:27.338258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:27.383149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:27.394414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:27.395217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.395499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.395773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.418447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:27.419849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-fe89f9c6-3096-4b9d-b6e5-ffea4d53d31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:27.445928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:27.446835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:27.447685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:27.447685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:27.447685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:27.447685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:27.459469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 238/462] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:27.461210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ffcc1-e9a6-44fe-a8de-9f373a8f6553 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.461696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ffcc1-e9a6-44fe-a8de-9f373a8f6553 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.461969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ffcc1-e9a6-44fe-a8de-9f373a8f6553 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.463301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 239/463] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:27.464267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ffcc1-e9a6-44fe-a8de-9f373a8f6553 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:27.473703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957712f-e884-48fd-807e-853f41ebc94d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:27.497147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:27.510921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe53-795a-4c5a-b2b1-fc61db048c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:27.512425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe53-795a-4c5a-b2b1-fc61db048c2e None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.513383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe53-795a-4c5a-b2b1-fc61db048c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.515013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe53-795a-4c5a-b2b1-fc61db048c2e None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.516568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe53-795a-4c5a-b2b1-fc61db048c2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:27.518318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe53-795a-4c5a-b2b1-fc61db048c2e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:27.589161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ffcc1-e9a6-44fe-a8de-9f373a8f6553 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:27.620145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 225/464] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:27 2022] POST /identity/v3/users => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:27.621335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3504f-76f2-4d78-834f-70d4fc5f1919 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.621627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3504f-76f2-4d78-834f-70d4fc5f1919 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.621906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3504f-76f2-4d78-834f-70d4fc5f1919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.635661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:27.636421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.636707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.636992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.637725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:27.638032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:27.639561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:27.647991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-95b3504f-76f2-4d78-834f-70d4fc5f1919 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:27.649583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-95b3504f-76f2-4d78-834f-70d4fc5f1919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:27.661536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 240/465] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:27.667573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:27.748129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:27.757375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 226/466] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:27.761649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c1a6-7d49-402b-b28b-62566ea18584 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.762020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c1a6-7d49-402b-b28b-62566ea18584 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.764411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1c1a6-7d49-402b-b28b-62566ea18584 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.767153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 227/467] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:27.773310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.773473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:27.774389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.776151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.802748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:27.804257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:27.804791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387edf-9174-4f4d-8c76-1d2092eb2781 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:27.853492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:27.853492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:27.853492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:27.853492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:27.854014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:27.856081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:27.882850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 228/468] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:27.885692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:27.971348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 241/469] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:27 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:27:27.972443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:28.010900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0efaa7-3143-42e9-bb28-d9d9b86f15d2 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:28.049024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:28.059197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:28.060727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.061193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.061636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.076206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:28.078972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:28.102783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed6ec-10fc-4591-a2e6-863b3852a1fe None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:28.127562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:28.128474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:28.129395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:28.129395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:28.129395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:28.129395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:28.130164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 229/470] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:28.137432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:28.178627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:28.179762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.180043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.181394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.197843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:28.206400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:28.207929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:28.240927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:28.241817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:28.243258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:28.243258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:28.243258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:28.243258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:28.243258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 242/471] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:28.248171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:28.320610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf0f7-011a-486e-9554-bd9ec18e1ef4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:28.360281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:28.361288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.361573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.361847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.363185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:28.363503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:28.365426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995ad43-37ff-4044-b414-3f3fc3dd769d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:28.368912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66143d4-ab87-4e90-ba17-f1563c55c262 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:28.378754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 230/472] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:28.380187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049c18-4c12-4c15-aef7-c3ee55f6addc None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.380477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049c18-4c12-4c15-aef7-c3ee55f6addc None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.380754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049c18-4c12-4c15-aef7-c3ee55f6addc None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.382242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 231/473] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:28.387011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049c18-4c12-4c15-aef7-c3ee55f6addc None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:28.409482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:28.410793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.411255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.411701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.412668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:28.413164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:28.415796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a174-5ed3-44d6-8f8a-e3024d6d7e34 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:28.436974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 243/474] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:28.438759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.439226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.439695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.442761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:28.461562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:28.463589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:28.508133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049c18-4c12-4c15-aef7-c3ee55f6addc None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:28.521501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:28.545116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:28.546135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.547154 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.547653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.548776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:28.550459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:28.556126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 244/475] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:28.557050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:28.665039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f3ad8-e1a1-4769-81ee-43ecba318164 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:28.699583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:28.700345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:28.700624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:28.700894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:28.701588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:28.703788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:28.855508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 232/476] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:28 2022] POST /identity/v3/users => generated 248 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:28.857030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:28.971383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:28.978007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb1cb-232b-404a-9e73-546d5e3fce8a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:29.009941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 245/477] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:28 2022] POST /identity/v3/users => generated 249 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:29.030068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:29.031399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:29.031686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:29.031962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:29.032758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:29.034164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:29.072338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.sql.core [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 13:27:29.072338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 13:27:29.072338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [parameters: {'id': 'fe017673bb824dd99009df66b968b8fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 13:27:29.072338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application conn.query(q) Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result.read() Jun 08 13:27:29.094320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return ref.to_dict() Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 13:27:29.095313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application next(self.gen) Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application yield resource Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application next(self.gen) Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise self.value Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application session.commit() Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 13:27:29.096758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.session.flush() Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application compat.raise_( Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 13:27:29.097621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 13:27:29.098502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application conn.query(q) Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result.read() Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 13:27:29.100883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [parameters: {'id': 'fe017673bb824dd99009df66b968b8fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:29.102905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 13:27:29.104953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:29.106919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 233/478] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 8 13:27:28 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:29.107054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:29.161238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:29.241231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b0221-3a2b-47dd-b84c-0105644567c5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:29.309032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45ed1-d13e-460b-ba41-9e830d09a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:29.309849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45ed1-d13e-460b-ba41-9e830d09a7bb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:29.310133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45ed1-d13e-460b-ba41-9e830d09a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:29.310409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45ed1-d13e-460b-ba41-9e830d09a7bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:29.321381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45ed1-d13e-460b-ba41-9e830d09a7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-34f45ed1-d13e-460b-ba41-9e830d09a7bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:29.330463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:29.331319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:29.332162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 246/479] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:29.337289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:29.446869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ede988-c6f2-4e73-ae91-c0142f4553f4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:29.482612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:29.483290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:29.483575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:29.484074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:29.485015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:29.485328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:29.486705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8438c1-2b05-4f12-bd64-34fae12d0343 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:29.495767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 234/480] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:30.267312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49796-ecf7-4603-96fc-517ad2735af8 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:30.268380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49796-ecf7-4603-96fc-517ad2735af8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:30.268898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49796-ecf7-4603-96fc-517ad2735af8 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:30.270882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 247/481] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:30.276678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:30.277653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:30.278175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:30.309198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:30.310765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:30.331848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:30.398649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 235/482] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:30.441921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49796-ecf7-4603-96fc-517ad2735af8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:30.555536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:30.567125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49796-ecf7-4603-96fc-517ad2735af8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:30.613805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ae1a5-c2fc-4876-a00b-20e7aadd51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:30.614655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae1a5-c2fc-4876-a00b-20e7aadd51e5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:30.614940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae1a5-c2fc-4876-a00b-20e7aadd51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:30.615216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae1a5-c2fc-4876-a00b-20e7aadd51e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:30.633700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ae1a5-c2fc-4876-a00b-20e7aadd51e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-828ae1a5-c2fc-4876-a00b-20e7aadd51e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:30.642230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:30.643110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:30.643894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 248/483] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:30.649406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:30.674581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dcf5f-4fb9-49cd-86f6-fff7b04d2165 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:30.674892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dcf5f-4fb9-49cd-86f6-fff7b04d2165 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:30.675137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dcf5f-4fb9-49cd-86f6-fff7b04d2165 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:30.676538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 249/484] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:30.684890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:30.685170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:30.685451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:30.711604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:30.712850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:30.811089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 250/485] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:30.816095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa6646-ac0d-4acd-be62-7a5cf81eb6d4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:30.849545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:30.850286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:30.850585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:30.850845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:30.851594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:30.851958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:30.853448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:30.854737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:30.863291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 236/486] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:30.868997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:30.897613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:30.958081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:30.974569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162fb3a-69ad-48f5-bf9b-b3093b797a9a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.012147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.013265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.013767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.014230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.025673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:31.034640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:31.035621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:31.036498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:31.038884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 251/487] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:31.048213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:31.075234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5570-54db-43c2-b5ac-96a5c7baa952 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.148206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.149015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.149300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.149578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.165546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:31.167009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:31.187755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:31.188668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:31.189512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:31.189512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:31.189512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:31.189512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:31.196156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 237/488] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:31.202367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:31.248319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d058e7-7b07-4e2e-921c-1cdc396e129a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.309316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.309986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.310236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.310486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.311232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:31.312039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:31.313536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:31.317431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:31.334809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 252/489] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:31.340798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:31.359936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:31.392448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829960ce-32ac-4f20-9c5e-3fdddfb1e6ab None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.450773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.451454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.451738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.452017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.452906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:31.453407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:31.454799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:31.482431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 238/490] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:31.487618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:31.525954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58077-3f56-46bb-b14d-616492c04798 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.595320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.596153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.596442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.596720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.621681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:31.623171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:31.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:31.648771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:31.649610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:31.649610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:31.649610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:31.649610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:31.662356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 253/491] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:31.665655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:31.686437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cf1da-1555-49ec-9c26-defd04a0ce92 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.729830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:31.750114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.751548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.753995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.755520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.771647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:31.774643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:31.792533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:31.803156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:31.805178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:31.806087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 239/492] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:31.815136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:31.922999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce9a0-dadf-4cde-81f2-57afb7d84d79 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.950026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbec5c-5ac7-4481-a3f6-f096046f3305 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:31.965564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:31.966236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:31.966514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:31.966787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:31.967505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:31.968407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:31.969952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:31.983062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 254/493] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:31.988405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.036783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.037476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.037760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.038041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.039138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:32.039449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:32.040909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5d890-bd72-4344-bbfd-22dead33136f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:32.103344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 240/494] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:32.105834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b59b57-ea67-4578-8ae4-430e29a1fbde None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.106386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b59b57-ea67-4578-8ae4-430e29a1fbde None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.106802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b59b57-ea67-4578-8ae4-430e29a1fbde None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.109349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 241/495] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:32.110318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b59b57-ea67-4578-8ae4-430e29a1fbde None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.115538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ff974-b328-4c7a-84a8-8b8c08dd0868 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.137570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.152408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.153351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.153635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.154003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.161806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:32.163520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:32.170618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-ad361913-68a6-4348-bdc7-b48ceaea7fc6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:32.181016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:32.187426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 255/496] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf900-5b66-4153-be7c-a2e3f714038b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.188762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf900-5b66-4153-be7c-a2e3f714038b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.189402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf900-5b66-4153-be7c-a2e3f714038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.203898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fecaf900-5b66-4153-be7c-a2e3f714038b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:32.205177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fecaf900-5b66-4153-be7c-a2e3f714038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:32.235289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b59b57-ea67-4578-8ae4-430e29a1fbde None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.270848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eec6d-ee8f-42ae-9c38-95a590b2408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.271493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eec6d-ee8f-42ae-9c38-95a590b2408d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.271778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eec6d-ee8f-42ae-9c38-95a590b2408d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.272068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eec6d-ee8f-42ae-9c38-95a590b2408d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.278154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 256/497] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:32.279589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86caa0-0fb0-4663-ba17-d187888fec6c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.279879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86caa0-0fb0-4663-ba17-d187888fec6c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.280228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86caa0-0fb0-4663-ba17-d187888fec6c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.284350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 257/498] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:32.286004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86caa0-0fb0-4663-ba17-d187888fec6c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.341697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eec6d-ee8f-42ae-9c38-95a590b2408d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:32.343452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eec6d-ee8f-42ae-9c38-95a590b2408d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:32.388229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.392459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86caa0-0fb0-4663-ba17-d187888fec6c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.403595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.427209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.427876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.428188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.428469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.429293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:32.429596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:32.431038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:32.442274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 242/499] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:32.443654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22467-f1aa-4a77-a477-fe2a30dba4ec None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.443968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22467-f1aa-4a77-a477-fe2a30dba4ec None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.444241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22467-f1aa-4a77-a477-fe2a30dba4ec None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.446451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 243/500] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:32.447031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.447294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.447672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.465011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:32.466189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:32.469440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 258/501] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:32.470288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.533391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 244/502] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:32.534135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.587791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a816-5e80-4fd2-933e-7f6a310c6a46 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.607231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.621924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daa0d5-ec7b-40cf-a381-98702255db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.622725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daa0d5-ec7b-40cf-a381-98702255db1e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.623007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daa0d5-ec7b-40cf-a381-98702255db1e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.623280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daa0d5-ec7b-40cf-a381-98702255db1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.631562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5591c-f61a-4595-83d7-8985f5d0b411 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.633247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85daa0d5-ec7b-40cf-a381-98702255db1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-85daa0d5-ec7b-40cf-a381-98702255db1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:32.641462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:32.642488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:32.643525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 259/503] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:32.644580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.644580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.644580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.661393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:32.662584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:32.670245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.671222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.671660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.671943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.681945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:32.683395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:32.684837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:32.703996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:32.704908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:32.705764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:32.705764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:32.705764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:32.705764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:32.705764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 245/504] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:32.706024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.732142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 260/505] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:32.732977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.837860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b8c0b-4305-4d67-bd3f-4f3e199446b1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.873410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.874974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.875319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.875598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.885681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:32.893970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:32.895049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 261/506] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:32.896028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:32.916479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.939334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6951bd-a925-4a8d-98c0-4135766a2dd5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:32.964171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:32.972019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:32.972690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:32.972969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:32.973247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:32.998166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1265-c80e-487d-b26c-74782c96d9a3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.033138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.033796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.034080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.034355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.035093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:33.035399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.036823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.039202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.040690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.044843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 262/507] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:33.047017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.142944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 246/508] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:33.143829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.173551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.250039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580013d-e715-4e64-bda3-824f4237d7db None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.251508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.270390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc789d46-c690-49fc-8048-d6bb782e209b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.284750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.285539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.285826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.286102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.297458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.298904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.304138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.304795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.305073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.305349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.306054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:33.306349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.307689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:33.317417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:33.318438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:33.319320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:33.319320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:33.319320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.319320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:33.319320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 247/509] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:33.319579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.322982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 263/510] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:33.322982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.400240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.420839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e0827-ec2d-4796-846c-3af24fa38951 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.421527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06801-cac3-4d10-9683-57aa27a7b24c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.454185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.454829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.454939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.455168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.455438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.455524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.455755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.456030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.456797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:33.457101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.458457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.464134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.466240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 248/511] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:33.466372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.467032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.468475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:33.486553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:33.487655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:33.488561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:33.488561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:33.488561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.488561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:33.488561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 264/512] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:33.488561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.572965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42f7af-83e0-479d-a3b3-b43825216b46 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.587265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e84af-2e29-4067-924e-ee2b57c8ffef None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.607745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.609482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.609773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.610054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.618645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.620899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.621701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.622331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.622427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.622623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.622899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.623611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:33.623925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.625312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.636732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 265/513] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:33.637521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:33.639009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:33.640429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:33.641364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:33.641364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:33.641364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.641364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:33.641364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 249/514] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:33.641364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.692480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.739246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4cf32-b68c-408d-9b05-1ce1bbf58e1a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.740970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abb2f-1984-41df-be5b-e32083b4c1bb None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.774088 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.774360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.774976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.775153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.775261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.775436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.775525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.775709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.782090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.783529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.786502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.787912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:33.799568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:33.800465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:33.801300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 266/515] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:33.801775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:33.805558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:33.806523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:33.813904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:33.813904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:33.813904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:33.813904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:33.813904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 250/516] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:33.813904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:33.856121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.910214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56625b6-afc9-433c-891d-2c4e703036b5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.910462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc217-3d39-4a2e-b1e0-365aaadd5b2d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:33.923346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:33.943776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.944409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:33.944557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.944841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.945073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:33.945177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.945357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:33.945634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:33.945817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:33.946123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.946342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:33.947561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.947793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:33.961020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 267/517] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:33.961815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.054698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 251/518] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:33 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:34.055605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.068531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df079a6c-1e40-45c6-b8c5-849d30378774 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.108171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.108849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.109127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.109399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.110125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:34.110453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.111833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.128960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 268/519] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:34.128960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.161529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:34.184078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:34.188780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2fb8-8f84-4fc3-bc0f-d746e0fb5736 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.232776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.233561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.233844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.234208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.235011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:34.235444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.236853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.242425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cdcc4-a5d5-4676-8150-ba3e086983e8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.256808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 252/520] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:34.258045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.318393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.319067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.319347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.319618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.320424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:34.320735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.322245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.335340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 269/521] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:34.336850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.394793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38e60-fcf5-4163-98bf-a68c7c85d8f3 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.433989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:34.438809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.439788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.440113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.440396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.444779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcddec1-689e-4744-bb79-e413ea515b39 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.448322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.449773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:34.464631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:34.465584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:34.466481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 253/522] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:34.468399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.489213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.490009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.490291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.490561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.494015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:34.498321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.500393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:34.514960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:34.515871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:34.516752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:34.520476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 270/523] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:34.521703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.585993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce658c47-ec44-4fd0-98e3-a6315d8d604d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.622050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.622805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.623093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.623376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.625233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=796757d15819413f8486471e778d95a6) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:34.625552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.626983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.633081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c60d38-60f5-4218-be86-dc79dacf1c08 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.633234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 254/524] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/role_assignments?user.id=796757d15819413f8486471e778d95a6&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:34.633883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.676759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.677587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.677871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.678148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.687447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.688980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:34.704545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:34.705738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:27:34.706963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:34.710513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 271/525] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:34.711465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.730161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:34.767184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:34.791858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d7821-978a-415d-b673-c78245ad21e4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.832836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580461-afa6-4279-addd-f78493a37f9f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:34.840199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.840868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.841183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.842166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.843646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:34.843959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.846053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.873049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:34.874029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:34.879232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 255/526] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:34.879232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.879854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:34.880193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:34.881007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:34.881325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:34.882804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:34.904173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 272/527] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:34.904173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:34.980432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.013213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb109-511d-4955-9c7a-ca493006b190 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.016191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5ff0-fd81-44cc-b47c-aa9b9af2b2bc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.057485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.058331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.058773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.059121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.059441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.060135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:35.060268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.060579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.060686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.060991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.065624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:35.086032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.096273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 256/528] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:35.097904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:35.150095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.152022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:35.235570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049bf85-a761-4d93-b2e5-88e8af850007 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.240449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.270450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 273/529] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:35.276110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:35.278372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.279230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.279675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.280667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.281691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=4cbadd181ac245969a762c302998fee1) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:35.282167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.283791 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:35.299909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 257/530] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:35 2022] GET /identity/v3/role_assignments?user.id=4cbadd181ac245969a762c302998fee1&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:35.299909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:35.415569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.453598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab99c7-7461-4d1d-b9f3-c85e1749590c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.488660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d36c1-0156-42c2-9225-54f3b85cf791 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.527193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.528017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.528323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.528602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.554799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.555476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.555755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.556028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.557638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.559110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:35.591945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:35.592967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:35.593805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:35.593805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:35.593805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:35.593805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:35.594671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 258/531] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:35.605125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:35.643469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.701296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.703224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:35.764653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137b238-142a-41fa-af3c-5ec1bacc3d4d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.804358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.818739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 274/532] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:35.829086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:35.860910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.861763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.862278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.862548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.863649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:35.863790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:35.892590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 259/533] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:35.898017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:35.916444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:35.942253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ad99-b0b8-44be-8285-42b616273d83 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:35.978474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:35.979460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:35.979838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:35.980267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:35.991452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:35.993089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:36.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:36.013091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:36.014365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:36.014365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:36.014365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:36.014365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:36.015920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 275/534] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:36.021573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.056378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfcdaa-e16a-4907-b5bf-4c54a5a61654 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.147104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76a68-3486-4fd9-a02e-2f31380e37c7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.152238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.154899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.160253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.160650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.169227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.171517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:36.187486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:36.188571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:36.189635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:36.191468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 260/535] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:36.196751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.208410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:36.225395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.226329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.226766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.227193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.228079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:36.228595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.231137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.255357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 276/536] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:36.261260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.268768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:36.402388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070e54-afcd-4a7d-8254-23738135bdde None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.418640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0da279-9631-4ebe-ba88-d7e6630d40d5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.455336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.456460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.456909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.457338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.464641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.466310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.481723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29311-8224-491e-9426-47af51f7553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.482320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29311-8224-491e-9426-47af51f7553d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.482602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29311-8224-491e-9426-47af51f7553d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.482933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29311-8224-491e-9426-47af51f7553d None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:36.483372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:36.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:36.485621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:36.486142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29311-8224-491e-9426-47af51f7553d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:36.486142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29311-8224-491e-9426-47af51f7553d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.486142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29311-8224-491e-9426-47af51f7553d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.487987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 277/537] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:36.493100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.519641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 261/538] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:36.525213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29311-8224-491e-9426-47af51f7553d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.589605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:36.621455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a2f0-c64a-498e-ab62-b426eae0a75d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.657160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:36.659702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.660420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.660703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.660978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.661765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:36.662076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.663774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929482b-4f49-43e3-ac57-3c568d1d56ac None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.665517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29311-8224-491e-9426-47af51f7553d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.679038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 278/539] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:36.680486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1e5a-7817-459a-b2d4-255e8de5af4e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.680777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1e5a-7817-459a-b2d4-255e8de5af4e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.681052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1e5a-7817-459a-b2d4-255e8de5af4e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.682679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 279/540] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:36.688448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.688992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.689273 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.711378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:36.713043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:36.719735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.720429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.720767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.721042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.721926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=7e6c3fd9ddab4118abf1729ac9a8f7c9) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:36.722240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.723666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.740000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 262/541] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/role_assignments?user.id=7e6c3fd9ddab4118abf1729ac9a8f7c9&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:36.741458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.871947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 280/542] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:36.896203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae776a-f49a-460e-bd35-9b7f3debc61d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:36.913068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:36.934066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:36.934763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:36.935010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:36.935285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:36.936348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=0a04840b445544828154575b4ac4a241) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:36.936666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:36.938359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:36.945355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 263/543] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/role_assignments?user.id=0a04840b445544828154575b4ac4a241&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:36.970671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:37.046583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87832-1a36-4ac1-b175-02ef7ac31551 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.083321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313c476-b4cd-477a-acbb-c81bd0efc25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:37.084164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c476-b4cd-477a-acbb-c81bd0efc25c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.084449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c476-b4cd-477a-acbb-c81bd0efc25c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.084718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c476-b4cd-477a-acbb-c81bd0efc25c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.096824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313c476-b4cd-477a-acbb-c81bd0efc25c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3313c476-b4cd-477a-acbb-c81bd0efc25c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:37.105204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:37.106154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:37.106963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 281/544] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:37.112924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:37.139832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c560c-ee88-4f5a-90d9-0b6c78f2284e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.140220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c560c-ee88-4f5a-90d9-0b6c78f2284e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.140498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c560c-ee88-4f5a-90d9-0b6c78f2284e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.141977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 282/545] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:27:37.147648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.148295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.148795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.151279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:37.170855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:37.173253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:37.284985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672de11b-6e5e-4268-a5fe-2d06770c5764 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.312025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 283/546] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:37.333622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:37.334716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.335192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.335674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.336642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:37.336795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:37.337290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:37.339193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:37.350408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 264/547] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:37.356596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:37.393556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:37.453494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:37.470354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28c31f-2b4c-46e7-8afe-915d26943f64 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.506777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:37.508465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.508975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.509442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.521039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:37.522845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:37.543619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:37.544566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:37.546733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:37.546733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:37.546733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:37.546733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:37.549138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 265/548] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:37.557780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:37.560456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5abdf-9ada-49bf-9c19-e59991c3b053 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.604888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:37.605625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.605912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.606179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.629136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:37.637752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:37.638649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:37.639981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:37.642834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 284/549] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:37.653123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:37.720934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933c61-cbb3-4cca-b101-5c910d0c05bf None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.781983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:37.782673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.782960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.783236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.783980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:37.788321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:37.789762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:37.806722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:37.816912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 266/550] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:37.824631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:37.850384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:37.881434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502cfe-1ff5-45ac-ac5e-09ca1267b7e9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.973534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030fcd6-39e8-4bb7-8f39-bb1a7964661f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:37.984791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:37.985484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:37.985770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:37.986050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:37.986808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:37.987115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:37.988552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.011565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 285/551] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:38.018278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.019097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.019382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.019661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.023064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.034730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.036539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:38.078018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:38.079007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:38.079926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:38.082705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 267/552] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:38.088199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.152147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861706e-384d-4b6f-807d-d1b43d3fb1d2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.191075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.192189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.192635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.192910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.204886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.206359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.213450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:38.219083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-ec9bfcd3-1359-435a-b931-7fa8b6b41c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:38.227659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:38.228550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:38.229464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:38.229464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:38.229464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:38.229464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:38.229464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 286/553] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:38.230752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c43b9-bea0-4aa1-a15a-e7c7ca13fb66 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.230752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c43b9-bea0-4aa1-a15a-e7c7ca13fb66 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.231048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c43b9-bea0-4aa1-a15a-e7c7ca13fb66 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.237092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 287/554] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:38.237092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c43b9-bea0-4aa1-a15a-e7c7ca13fb66 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.283890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7a9a-13cb-43f3-bb88-8a58c1758870 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.333147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.334400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.335122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.335675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.337056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:38.337373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.338833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37a1d-61e1-4831-aca5-2016e8bbc860 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.363285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 268/555] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:38.363285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.363285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.363285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.366837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c43b9-bea0-4aa1-a15a-e7c7ca13fb66 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.381459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:38.382678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:38.414416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.415012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.415295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.415565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.416324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:38.416642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.417993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.432186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 288/556] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:38.433171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.461140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 269/557] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:38.462389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.513051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:38.523748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:38.563004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb43a5-bfbd-444d-923e-71627e996352 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.594876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5528b5-bdb0-49df-b8b9-9bf619307032 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.600913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.601572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.601855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.602129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.633848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.635211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.635695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.636203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.646010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.648042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:38.664833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:38.666249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:38.667229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:38.670620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 270/558] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:38.671733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.676454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.677460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.741560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:38.784249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5cd42-719e-4e44-953e-47c490a5c95c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.793555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 289/559] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:38.793555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.799631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:38.830869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.831827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.832235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.832580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.847284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:38.855479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:38.856555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:38.857713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 271/560] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:38.862422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:38.906255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf146-e384-4f10-95ff-d668ef1e3c21 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.949167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:38.950325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:38.950981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:38.951653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:38.953066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:38.954620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:38.956885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:38.974196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52b65-6cc1-4279-8777-10a84c77a164 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:38.981014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 290/561] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:38.982607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.004368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.011807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.012749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.013341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.013699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.027876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.030025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:39.054442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:39.055847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:39.056995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:39.056995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:39.056995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:39.056995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:39.060739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 272/562] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:39.062454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.092876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.124112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760649-c47d-49a3-896e-e0f646a4eda5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.164585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.165265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.165550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.165821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.166568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:39.166978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.168450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.183320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 291/563] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:39.184299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.202868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b156-51de-4f8d-b903-21421933e205 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.249790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.250590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.250875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.251152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.264390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.265953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:39.286100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:39.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:39.288237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:39.288237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:39.288237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:39.288237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:39.288237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 273/564] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:39.288530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.308213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.331059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0e790-a333-44a3-84a7-71cc48f99a13 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.364132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.366212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.366897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.367179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.367452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.368222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:39.368530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.369924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d337b38-651b-471b-8692-63726d2f96e1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.387715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 292/565] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:39.387715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5315a6-de79-4d97-94e3-66df98e7fc73 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.387715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5315a6-de79-4d97-94e3-66df98e7fc73 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.387715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5315a6-de79-4d97-94e3-66df98e7fc73 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.387715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 293/566] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:39.387715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5315a6-de79-4d97-94e3-66df98e7fc73 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.405572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c095-c839-4422-99f0-51a20147b463 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.444726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.446393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.446849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.459670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.461086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:39.479197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:39.480169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:39.481066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:39.481066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:39.481066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:39.481066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:39.481066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 274/567] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:39.481343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.502436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5315a6-de79-4d97-94e3-66df98e7fc73 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.540966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.541639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.541922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.542195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.542912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:39.543216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.544636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f506-65b5-4456-a043-56a1021a95eb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.551671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.557227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 294/568] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:39.558472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.558761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.562697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.575693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:39.577977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:39.592597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee4942-9b12-4b47-90ec-26c6b1e5787f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.614720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.627273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.628074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.628365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.628637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.635385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.636905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.644559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 295/569] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:39.645388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-8abff086-16ad-4f52-ab12-3053c99887a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:39.664461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:39.665374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:39.666520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:39.669890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 275/570] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:39.669890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e40d66-4886-48f2-b001-f2c8100d86b9 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.669890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e40d66-4886-48f2-b001-f2c8100d86b9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.670502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e40d66-4886-48f2-b001-f2c8100d86b9 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.671790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 276/571] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:39.672584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e40d66-4886-48f2-b001-f2c8100d86b9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.745104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513520-3fcd-4ce5-bf3e-e1810ff96d83 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.771162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.773156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e40d66-4886-48f2-b001-f2c8100d86b9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.778569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.779763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.780177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.784586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.784586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:39.784586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.784586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.794114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 296/572] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:39.795072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.813222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.814014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.814293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.814562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.821348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.822772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:39.836762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:39.837700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:39.838597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 277/573] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:39.839089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:39.886359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:39.898199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efe64-6597-4b94-a4c0-51f10bd533ab None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.931798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4db128-51b1-4860-be51-41b1902a036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.932616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db128-51b1-4860-be51-41b1902a036b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.932904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db128-51b1-4860-be51-41b1902a036b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.933176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db128-51b1-4860-be51-41b1902a036b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.943482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4db128-51b1-4860-be51-41b1902a036b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:39.944338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19172430-0bf0-4caa-94bb-fcbabf2bce68 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4f4db128-51b1-4860-be51-41b1902a036b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:39.951729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:39.952722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:39.953549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 297/574] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:39.954539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.954819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.955093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.971378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:39.972687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:39.983800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:39.984496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:39.984778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:39.985053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:39.985835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:39.986144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:39.987555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.000201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 278/575] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:40.000926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.017834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.040687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 298/576] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:40.042062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.103296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30289c3c-cc28-4e9f-86d6-f1c9d466b044 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.104870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.138064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.139397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.139757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.139967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38cea-326b-4cc8-92a3-69a90aa87672 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.140111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.148462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.150254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:40.165074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:40.166114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 279/577] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:40.167066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.176416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.177078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.177358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.177629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.178412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:40.178717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.180296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.191784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 299/578] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:40.192612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.273881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.300850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a586-acc8-4e58-87ce-5b92890fc451 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.334693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.335363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.335651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.335930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.336646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee959b-6f6c-4ed5-b610-dd8a07f36a65 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.336753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:40.337006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.338377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.346390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 280/579] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:40.347176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.371188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.375909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.376598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.376877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.377145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.377966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=a20d31e9b69d4807a3e31f796fca6274) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:40.378344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.379775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.385236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 300/580] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/role_assignments?user.id=a20d31e9b69d4807a3e31f796fca6274&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:40.386014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.455744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14cafe-79be-4e4f-b88f-90db82a6e563 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.492013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.492865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.493149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.493425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.505691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:40.509693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e80d-b34c-47a0-bfe0-8ea62aae9916 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.511637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:40.514237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:40.515708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:40.516700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:40.520476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 281/581] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:40.521418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.553222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.553885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.554164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.554436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.555322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:40.555632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.557155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.576362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 301/582] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:40.577218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.621499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.638096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10b1d-32ac-4ab8-bb37-9cee02bf7314 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.675264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.676717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.676950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.677205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/796757d15819413f8486471e778d95a6/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.693564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=796757d15819413f8486471e778d95a6, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.694198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c309c-4203-4183-b646-a5f98f1c6af3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.695012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.730651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.731455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.731738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.732012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.742601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.744076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:40.761930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:40.765060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:40.766023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:40.766023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:40.766023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:40.766023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:40.766023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 302/583] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:40.766023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.780394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 282/584] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:27:40 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/796757d15819413f8486471e778d95a6/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:40.780394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.781548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.884038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66513-62cc-431a-b4d2-fabac04270d7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.917610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005c92-7af1-485d-a1b3-5abb2efeaa3f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:40.929143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.929923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.930299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.930638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.931508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:40.931934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.933495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.947867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 303/585] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:40.948984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:40.956442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:40.957260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:40.957540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:40.957814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:40.965650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:40.970497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:40.972234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:40.992626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:40.993598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:40.994490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:40.994490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:40.994490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:40.994490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:40.994490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 283/586] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:40.995308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.036130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.068618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45fe2-a81e-4c96-bf6f-428e4bd50ad4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.114878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02157b-ebe7-4fa0-9fcb-5dcb017f771f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.115472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.116480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.116826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.118042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.118843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:41.119211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.120723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.137927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 304/587] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:41.138835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.159519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.160899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.161242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.161784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.176902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.179008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:41.203780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:41.206733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:41.207641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:41.207641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:41.207641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:41.207641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:41.207641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 284/588] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:41.207641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.263359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.264986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce678cb-a1aa-4666-8a0c-35f5d7f1ceb6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.312196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.313759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.314459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.314879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.316085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:41.316978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.318998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.321329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.325736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726f849-d0fd-4ac7-8350-d4811e36387a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.335633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 305/589] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:41.336763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.365631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.366619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.366903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.367179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.375287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.376905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:41.393965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:41.395213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 13:27:41.396373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:41.399813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 285/590] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:41.400770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.464680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05705e4-04e6-4262-ac2b-9c7de7992478 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.507728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.508983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.509679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.510095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.511104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:41.511850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.513905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.514098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.518566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2104-b275-42a8-8a92-fbcefab81999 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.530500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 306/591] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:41.531700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.565435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.566410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.566758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.567352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.577299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.578799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:41.597549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:41.598467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 286/592] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:41.599956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.608489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.657179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2121aee-24b6-4d84-9a40-9ff44b6be55c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.701524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711da65-2871-455d-867a-e79247917aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.702416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711da65-2871-455d-867a-e79247917aee None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.702705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711da65-2871-455d-867a-e79247917aee None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.702990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711da65-2871-455d-867a-e79247917aee None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.703828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711da65-2871-455d-867a-e79247917aee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:41.704179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711da65-2871-455d-867a-e79247917aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.705749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711da65-2871-455d-867a-e79247917aee None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.725100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 307/593] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:41.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711da65-2871-455d-867a-e79247917aee None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.738995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522e336-84e0-44a4-8987-baf92bc15a28 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.785047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.785853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.786140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.786849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.798055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.799503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:41.819120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:41.820109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:27:41.821059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:41.824206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 287/594] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:41.825076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.839055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711da65-2871-455d-867a-e79247917aee None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.850249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.853258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:41.876420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.877306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.877989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.878423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.879399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:41.879915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.881599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:41.896895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 308/595] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:41.898091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:41.947316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a864619-d70a-4675-b8f6-70578fd13f09 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:41.984669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:41.985117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:41.985404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:41.985686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:41.996734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:41.998928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.014612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb50827-3431-499c-89c2-db1731255819 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:42.018469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:42.019538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:42.020742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:42.020742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:42.020742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:42.020742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:42.024344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 288/596] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:42.025216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.058030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.059089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.059615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.060221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.061332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:42.061792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.063550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.084103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 309/597] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 8 13:27:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:42.085205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.106317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:42.121207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:42.139420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92edc5-2a70-4a01-bd47-28afefd3f1d7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.177887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.178789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.179075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.179355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/4cbadd181ac245969a762c302998fee1/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.196367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=4cbadd181ac245969a762c302998fee1, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.197705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.206393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813d6ae-9a94-4c46-add1-16eee8ca5a3b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.246446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.247360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.248950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.249483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.250361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:42.250820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.252423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.265876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 310/598] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:42.266936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.332378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 289/599] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:27:42 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/4cbadd181ac245969a762c302998fee1/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:42.333607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.382915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:42.396494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e59ea4-99d9-4ab3-bd70-2cfb45d991b4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.439077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.440228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.440663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.441117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.455153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.457074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:42.478719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:42.479900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:42.481122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:42.481122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:42.481122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:42.481122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:42.483787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 311/600] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:42.489307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.581902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ce29-a6a2-4413-94de-1628d7f3d631 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.612644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:42.632515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.633980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.634270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.634550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.643849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.645668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.658919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e4de-4807-4584-9a96-cdedaebd23c5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:42.662802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:42.663883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:42.665060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:42.666913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 290/601] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:42.673372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.701194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.701970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.702257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.702534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.703257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:42.703561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.704987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.719702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 312/602] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:42.725157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.727890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:42.825237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd187-e6ee-44e1-96a4-f2f5f6d893d7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.831704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfdd51-5b6a-4a96-b1b9-5fe629b8c125 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:42.868711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.869609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.869957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.870322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.875164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:42.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.876547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.877023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.878303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:42.878648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.878990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:42.880363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.880924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79170a-3f9a-4d90-ba06-0f703a2a6750 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:42.896433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:42.897405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:42.898303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:42.899486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 291/604] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:42.901200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043820ef-eb14-483b-8634-b77a1272644d None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:42.901818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043820ef-eb14-483b-8634-b77a1272644d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:42.902261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043820ef-eb14-483b-8634-b77a1272644d None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:42.903124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 313/604] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:42.905032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 292/605] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:42.909983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.910168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043820ef-eb14-483b-8634-b77a1272644d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:42.968654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:42.984719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:43.035572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9c7e-43a0-4189-a152-dccbce53833c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.044755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043820ef-eb14-483b-8634-b77a1272644d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.082447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.083689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.084395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.084895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/7e6c3fd9ddab4118abf1729ac9a8f7c9/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.085470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.088844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.088844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.088844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.088844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:43.088844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:43.089347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c02c-d092-4d90-b0b2-ac425f479e51 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:43.104800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 314/606] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:43.105946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.106236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.106507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.116604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=7e6c3fd9ddab4118abf1729ac9a8f7c9, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:43.118294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:43.133154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:43.134565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:43.208922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 315/607] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:43.209576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:43.229762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 293/608] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:27:42 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/7e6c3fd9ddab4118abf1729ac9a8f7c9/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:43.237690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:43.290072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:43.351182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ca7f-5500-4d22-81a8-6aca999aa63d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.380135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:43.392534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.393281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6103d-5c3c-42ee-a872-2df5800a796b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.394128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.394606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.395062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/0a04840b445544828154575b4ac4a241/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.422153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=0a04840b445544828154575b4ac4a241, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:43.423996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:43.433811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1ddac-406c-4b9a-b979-7aec41c68423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.434614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1ddac-406c-4b9a-b979-7aec41c68423 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.435390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1ddac-406c-4b9a-b979-7aec41c68423 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.435678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1ddac-406c-4b9a-b979-7aec41c68423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.448783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1ddac-406c-4b9a-b979-7aec41c68423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-9ae1ddac-406c-4b9a-b979-7aec41c68423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:43.457519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:43.458662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:43.459549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 294/609] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:43.460353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520a5e1-c275-4e4d-bbd7-57c06e608d2a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.460353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520a5e1-c275-4e4d-bbd7-57c06e608d2a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.460937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520a5e1-c275-4e4d-bbd7-57c06e608d2a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.463867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 295/610] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:43.470122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.470122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.470321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.489204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:43.490327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:43.498272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 316/611] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:27:43 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/0a04840b445544828154575b4ac4a241/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:43.499389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:43.583731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 296/612] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:43.615276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:43.638310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70188-f139-47c0-a776-656fa431d076 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.640855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:43.690716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.692365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.693720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.694191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.695144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:43.695635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:43.697301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:43.709792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 317/613] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:43.710979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:43.717214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:43.747043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7657c-9d57-4ee0-94d5-80633a55b726 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.834090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.834903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.835189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.835470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.852965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba384c1-26e4-4a5f-b013-d3cb57d83338 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:43.863790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:43.874988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:43.875975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:43.876863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:43.878076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 297/614] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:43.884092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:43.907806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:43.908705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:43.908991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:43.909263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:43.931669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:43.933248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:43.970279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:43.971266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:43.972187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:43.972187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:43.972187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:43.972187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:43.972605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 318/615] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:43.982982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:44.019504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:44.100862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534903a-572e-4f96-b367-3b3a7eda9e83 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:44.175915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:44.176868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:44.177344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:44.177809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:44.178770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:44.181047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e8d3-e7c0-4770-9183-b7dcb9738d96 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:44.181526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:44.183062 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:44.194340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 298/616] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:44.204192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:44.204408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:44.261466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:44.262243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:44.262529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:44.262806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:44.263628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:44.263934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:44.265520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:44.295952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 319/617] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:44.301111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:44.309290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc13da-9ccb-4010-82b3-1ba83c492538 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:44.346957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:44.347865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:44.348184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:44.348458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:44.360732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:44.362183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:44.380735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:44.381695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:44.382581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:44.382581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:44.382581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:44.382581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:44.382581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 299/618] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:44.387713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:44.457326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:44.458979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:44.502677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038786d0-2c3b-4834-b94e-d81d51c63b3f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:44.524858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2427a-7f1a-47f2-90d8-6eccad8ef972 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:44.542425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:44.543069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:44.543352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:44.543628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:44.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:44.545250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:44.546700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:44.576717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 300/619] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:44.576717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:44.615408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:44.616229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:44.616524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:44.618763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:44.630464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:44.632196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:44.679835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:44.680900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:44.681888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 320/620] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:44.693155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:44.756639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6610d-226e-4839-8326-192e13834e4a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:44.772748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:44.803233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:44.804224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:44.805774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:44.805774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:44.827083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:44.831074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:44.865807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:44.867314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:44.868793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:44.876738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 301/621] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:27:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:44.883156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.011684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989504-077b-4d68-9826-dcbd1a8abec2 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.027448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301d0b-a837-4d1b-ad13-5ddd12836edf None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.053324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.054893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.055376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.055850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.056998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:45.058748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:45.061225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:45.114091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 302/622] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:27:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:45.115423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.120601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.121573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.122198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.122897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.125112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:45.130969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:45.132776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:45.139840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:45.176849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 321/623] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 8 13:27:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:45.180537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.194876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:45.309461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0043b-34ab-41b8-b932-e859f01b6856 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.356284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.357366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.357844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.358584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.448617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:45.450905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:45.459161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91d7d5-058e-4d85-b606-4b18447f0996 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.494515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:45.497357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.498676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.499194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.499702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.518009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:45.519546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-f3f700a6-a21d-472d-9215-92ea4abd1130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:45.544926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:45.545900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:45.546770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:45.546770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:45.546770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:45.546770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:45.551052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 322/624] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:45.552526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d2f7-8e81-4056-801e-c78f1ba162c2 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.552810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d2f7-8e81-4056-801e-c78f1ba162c2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.553087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d2f7-8e81-4056-801e-c78f1ba162c2 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.558846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 323/625] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:45.561694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.561922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.562202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.584310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:45.585514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:45.590785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 303/626] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:45.590785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.639254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:45.692369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 324/627] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:45.694864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.715219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bfc9d-1cf2-4e1f-8684-b4af352d711c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.754050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:45.761189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.762443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.763536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.764142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.765389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:45.765861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:45.768541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:45.787431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 304/628] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:45.788637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.868900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4631-3d84-4de8-a99f-9fbc34dac20e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.916767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.918150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.918851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.919917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.925690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736de50-580f-4e34-8911-4ba32c177a7d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:45.933901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:45.936115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:45.958972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:45.960221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:45.961347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:45.961347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:45.961347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:45.961347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:45.963535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 325/629] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:45.964662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:45.975279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:45.976322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:45.976711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:45.977117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:45.989463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:45.997826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:45.998977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:46.000028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:46.003223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.006243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 305/630] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:46.007197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.071406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.101403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1007eaa-b5e8-4bff-b1cb-8a5e5a52b9e6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.131620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3792b4-2be3-4eef-adcd-9444aa6e7de4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.141386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.142185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.142469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.142740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.149488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.150954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:46.165782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:46.166798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:46.167682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 326/631] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:46.168222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.169817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a379a-5660-414a-adc3-766286474d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.170480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a379a-5660-414a-adc3-766286474d8f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.170759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a379a-5660-414a-adc3-766286474d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.171032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a379a-5660-414a-adc3-766286474d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.171747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a379a-5660-414a-adc3-766286474d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:46.172206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a379a-5660-414a-adc3-766286474d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.173416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a379a-5660-414a-adc3-766286474d8f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.186453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 306/632] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:46.187700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7a94-5acb-4961-a1cd-8f1e60f525c7 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.187981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7a94-5acb-4961-a1cd-8f1e60f525c7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.188280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7a94-5acb-4961-a1cd-8f1e60f525c7 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.189487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 307/633] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:46.190540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094221e0-13ab-467c-8782-454489b5f108 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.190940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094221e0-13ab-467c-8782-454489b5f108 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.191058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094221e0-13ab-467c-8782-454489b5f108 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.192435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 308/634] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:46.193385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094221e0-13ab-467c-8782-454489b5f108 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.268280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.281212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d02eb1-818f-4953-b4b8-44be0b10aefa None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.299384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094221e0-13ab-467c-8782-454489b5f108 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.312396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.315095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.315836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.316156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.316437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.317174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:46.317480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.318849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.326744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 327/635] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:46.327573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.333828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.334501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.334767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.335042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.335833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:46.336168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.337586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563de3-edeb-4474-b884-3fbb383f6c90 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.355275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 309/636] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:46.355275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74a5c-9f0f-4ee2-83b9-82678510f6b5 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.355275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74a5c-9f0f-4ee2-83b9-82678510f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.355275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74a5c-9f0f-4ee2-83b9-82678510f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.371192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-03e74a5c-9f0f-4ee2-83b9-82678510f6b5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:46.373014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-03e74a5c-9f0f-4ee2-83b9-82678510f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:46.428327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb198f-9277-49e5-ac3c-5d0ac29adcfc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.437940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 310/637] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:46.439183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.439468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.439741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.461709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:46.462915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:46.472306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.473102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.473381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.473655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.480229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.481741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:46.495808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:46.496757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:46.498178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 328/638] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:46.498670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.510231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.532647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 311/639] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:46.533808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.571652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.599682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609afbe4-3fe3-4d5f-af73-30b09c59eca0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.632871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.633666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.633953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.634232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.640380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4fb2e-1d56-44ef-ac55-35dd472b4813 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.645436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.646903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:46.672180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:46.673078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:46.673993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:46.673993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:46.673993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:46.673993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:46.673993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 329/640] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:46.674279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.675785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.676711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.676989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.677259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/a20d31e9b69d4807a3e31f796fca6274/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.692128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=a20d31e9b69d4807a3e31f796fca6274, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.693560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.735083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.765234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 312/641] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:27:46 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/a20d31e9b69d4807a3e31f796fca6274/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:27:46.766079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.774188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddbe78-c99f-4e37-b3b0-0402795c0793 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.816758 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.817576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.818224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.818501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.831140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:46.839171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:46.840298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:46.841222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 330/642] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:46.841922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.868770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:46.892896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe729-3920-48f4-9bf9-6d59ca92ce47 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.931979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:46.932785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:46.933133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:46.933411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:46.934207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:46.934598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:46.936313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:46.954981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 313/643] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:46.954981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:46.971160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad199c-6dcd-451e-9c29-59afd4116b72 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:46.994552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.007212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.008013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.008330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.008664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.019803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:47.027498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:47.029054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:47.030116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 331/644] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:47.030997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.073077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a155c-1f4a-4077-9da0-e2010f13462b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.111656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.112358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.112640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.112963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.113684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:47.113990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.115348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.132656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 314/645] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:47.132656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.133792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.145971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cbe9b-1282-42b0-a405-49f6d9ae2380 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.181603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.182274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.182556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.182833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.183569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:47.183929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.185784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.198272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 332/646] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:47.198272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.241972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.245186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903abed-03f0-4543-9504-741a560551f1 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.282221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.282876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.283157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.283432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.284292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=796757d15819413f8486471e778d95a6) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:47.284594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.286006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.292087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 315/647] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/role_assignments?user.id=796757d15819413f8486471e778d95a6&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:47.292869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.312340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194999fc-a9fa-47e5-b814-02e0967a8ac2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.368848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.370152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.370587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.371083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.372484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.373386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:47.374516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.376495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.391126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 333/648] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:47.392433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.421429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860350d-030c-4688-a826-a9530e3f7f22 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.473618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.475409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.475845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.476567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.489529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.491248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:47.511160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:47.512172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 13:27:47.514089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:47.515684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 316/649] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:47.515684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.524106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0293-40e1-4773-88ac-d6ec865055b6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.530951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.576169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.576990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.577271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.577597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.591909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.593124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:47.615370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:47.616357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:47.617259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:47.617259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:47.617259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:47.617259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:47.617888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 334/650] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:47.620140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.653578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8135-e7a0-4d36-a3bc-3ac2e440c1fc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.682066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.693489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.694561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.694931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.695309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.707402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.709218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:47.729793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:47.730903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:47.732304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:47.732304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:47.732304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:47.732304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:47.733980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 317/651] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:47.738859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.754385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b51607-0823-4335-bff9-6cc3e353f9bc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.802185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.803605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.804175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.804592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.805566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:47.806014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.808474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.832569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 335/652] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:47.834396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.849852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b540-67fc-4e8d-bd7f-b2af586d75e0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.859290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:47.886394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:47.887246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:47.887712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:47.888150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:47.889462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:47.889462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:47.891014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:47.910729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 318/653] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:47.912177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:47.961670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220c929-1681-47b8-8d75-4bb620ca5287 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:47.968428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.000805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.001483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.001769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.002044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.002934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:48.003247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.005101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.024093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 336/654] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:48.024093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.052988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d22f-c1dc-4dfa-af81-8e267099a92f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.099621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.100417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.101203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.107369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.132369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a792-ac44-4d8b-a4e2-966e26a77749 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.170408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.171207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.171484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.171749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.175428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.176915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.186949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.188919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:48.207625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:48.208676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 13:27:48.209618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:48.213477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 337/655] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:48.214326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.223808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.303802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 319/656] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:48.304677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.326200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2d310-df01-40ac-9f7f-4efd190790e0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.371569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.374373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.374666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.375005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.378373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.383644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.385211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:48.400621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:48.407414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 338/657] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:48.408378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.441166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5085b-41e1-4934-b766-42e5fb04d0fe None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.486621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.487563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.488113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.488399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.489234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:48.489543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.491600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.502696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.514532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 320/658] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:48.515393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.543560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fdc8-f1ad-4c2c-a610-ba057b5e2a76 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.588413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.590349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.591374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.592146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.607711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.610261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.628488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0c4ef-301a-425a-817c-45d297725c5f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:48.634542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:48.635413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:48.636324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:48.636324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:48.636324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:48.636324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:48.638876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 339/659] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:48.640250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.669136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.670247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.670739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.671220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.672340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:48.672858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.674567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.699449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.704166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 321/660] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:48.705285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.757442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537393a-dd00-4328-8a38-aade9e9ff1f3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.796507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:48.798741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.799705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.800273 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.800624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.849140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b614a4-5f20-4d41-a398-7b7e7a5eff63 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:48.881373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.883086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.894873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:48.896220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:48.896534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:48.896818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:48.897564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:48.897873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:48.900872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:48.913355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 322/661] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:48.914180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:48.946979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.008480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 340/662] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:49.009738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.040439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52355d5f-5dcb-4f3e-9698-e399169bb878 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.055893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.093076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9814e8c-032e-4091-ada7-07a487f485dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.094523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9814e8c-032e-4091-ada7-07a487f485dc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.095303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9814e8c-032e-4091-ada7-07a487f485dc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.096196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9814e8c-032e-4091-ada7-07a487f485dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.136568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc289e6-e639-4d67-b0c5-1070c6550d07 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.174574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.175384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.175741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.175939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.182962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.184286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9814e8c-032e-4091-ada7-07a487f485dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.185576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.186219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9814e8c-032e-4091-ada7-07a487f485dc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:49.199442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:49.201169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 341/663] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:49.202090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.213984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.303332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 323/664] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:49.304995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415585-5e81-42d6-bdd6-2111241a21cb None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.305283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415585-5e81-42d6-bdd6-2111241a21cb None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.305560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415585-5e81-42d6-bdd6-2111241a21cb None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.308105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 324/665] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:49.308105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415585-5e81-42d6-bdd6-2111241a21cb None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.326833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.327217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171ffe-2f28-46c6-93bd-cca7e87891ef None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.362625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.363425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.363708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.363981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.375641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.377116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:49.395100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:49.396079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:49.397009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:49.397009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:49.397009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:49.397009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:49.401082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 342/666] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:49.401855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.435310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415585-5e81-42d6-bdd6-2111241a21cb None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.478296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.479126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.479330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.479592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.480612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:49.480734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.481211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.482527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c331-647b-406d-92ad-1a7af253a4de None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.494732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 325/667] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:49.496160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.496452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.497290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.515074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:49.516300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:49.531440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe08e84-487c-4a08-90e3-48c9161bc6ca None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.569598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.570442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.570725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.571148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.583912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.585257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.588019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 326/668] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:49.588849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.593655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:49.612732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:49.621795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:49.622876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:49.622876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:49.622876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:49.622876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:49.622876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 343/669] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:49.622876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.707300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13340d-2c25-4f32-84e8-e99ed19f92fc None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.725434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92963876-074d-4032-80dd-895b3f82bf23 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.739347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.743852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.744547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.744832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.745108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.745826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:49.746131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.747727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.759029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 327/670] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:49.759818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.759959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.760581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.760869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.761141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.761963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=4cbadd181ac245969a762c302998fee1) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:49.762809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.764741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.771236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 344/671] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/role_assignments?user.id=4cbadd181ac245969a762c302998fee1&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:49.772024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.837364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:49.882251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e4932-2001-4d2a-815d-54cff416faf5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.892230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4fcf-dda7-476f-a5da-a76c797a5f75 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:49.922815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.923778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.924093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.924372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.930401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:49.931077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.931361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.931633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.932398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:49.932704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:49.934193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a472-14ef-4094-b5b4-0145024e33fb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:49.936520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:49.944516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:49.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:49.946412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:49.954466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 345/672] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:49.954655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 328/673] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:49.954736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060dad-531f-4d2d-af28-28b102548361 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:49.954736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060dad-531f-4d2d-af28-28b102548361 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:49.954889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.954963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060dad-531f-4d2d-af28-28b102548361 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:49.954963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 346/674] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:49.955512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e060dad-531f-4d2d-af28-28b102548361 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:49.995585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.072880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f440-1331-4a0a-a5ba-68b19f51d45f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.073435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e060dad-531f-4d2d-af28-28b102548361 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.102661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.113599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.114091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.115608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.115608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.115608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.115833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.115833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.115833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.116023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.116023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.117269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.124251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.125862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.130839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 347/675] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:50.130839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-2dad26f8-50a1-4cd4-b68e-3a47e84e80f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:50.146347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:50.147310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:50.148241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 329/676] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:50.149335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.149335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.149513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.166721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:50.167923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:50.235495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.239659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7e10c-4c6b-4473-b278-e24609ba94c7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.252256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 330/677] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:50.252256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.279836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.280762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.281043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.281354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.288666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.290115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:50.304447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:50.305380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:50.306262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 348/678] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:50.306773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.365869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef89bbe-a2b8-4a0e-87be-62fd2a94b55d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.380320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.401279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.402085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.402371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.402645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.413756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.415204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.419113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e5d7-a1e6-4ce5-be89-f2f42143b3b7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:50.434848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:50.435964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:50.442015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:50.442015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:50.442015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:50.442015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:50.442015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 331/679] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:50.442015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.459826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.460530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.460813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.461087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.461868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.462176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.463605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.476436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 349/680] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:50.477310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.500545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.554260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16264-05cc-4cd7-917e-0e2e97379663 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.584240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577635c9-dde2-4119-bd2f-11074f3bbd8c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.594189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.595022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.595263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.595531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.607112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:50.614757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:50.615666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:50.616540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 332/681] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:50.617319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.625038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.625712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.626000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.626278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.627069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.627377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.628860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.643879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 350/682] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:50.647650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.649673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.724272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921716-901d-4f08-8d4a-a1f8832b8cc9 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.732945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.755563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efebdfb-5b3b-4528-83a0-8f47f1b5855f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.763428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.764292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.764824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.765244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.766134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.766445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.767797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.783800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 333/683] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:50.785221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.794898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.795556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.795834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.796132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.796953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=7e6c3fd9ddab4118abf1729ac9a8f7c9) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.797260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.798676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.816184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 351/684] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/role_assignments?user.id=7e6c3fd9ddab4118abf1729ac9a8f7c9&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:50.816184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.900217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:50.919860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84f03-43c6-429c-a155-50364e9ae25a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.940784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd3f5-44a5-4ccb-8b78-210ae679718d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:50.960936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.961829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.962218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.962628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.963520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.964632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.967374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:50.979933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 334/685] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:50.981535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:50.982307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:50.983132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:50.983484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:50.983856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:50.984788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=0a04840b445544828154575b4ac4a241) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:50.985209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:50.986787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.000199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 352/686] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/role_assignments?user.id=0a04840b445544828154575b4ac4a241&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:51.001313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.015558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:51.113569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599a7d-249e-40ef-963b-e957b709a744 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.153445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64140081-1445-47ec-9a16-a8c43a03d813 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.155061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.156079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.156495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.157837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.169819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:51.171449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:51.187565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:51.188863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:51.190024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 335/687] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:51.196129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.200936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.201813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.202101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.202376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.210343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:51.216396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:51.217994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:51.241323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:51.242512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:51.243723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:51.243723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:51.243723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:51.243723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:51.243723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 353/688] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:51.250835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.322873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c428230-2538-4785-9a3c-ca9effa68a38 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.326247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:51.364034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.365073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.365778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.366196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.367308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:51.367767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:51.369518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.376110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b3c0-7674-498c-82a4-0a5e281a300c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.390592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 336/689] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:51.396968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.420593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.421939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.422369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.422830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.423718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:51.424255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:51.426679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.443953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 354/690] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:51.450111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.480475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:51.529937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141cac9-3963-492e-9f6a-15508be6deec None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.578175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.579069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.579497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.579915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.581109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b60a7-59d4-48c0-9c17-e9eba639e6c3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.615052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:51.650121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.651343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.652435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.653231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.669504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:51.671031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:51.698331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:51.699342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:51.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:51.701052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:51.704084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:51.706156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 355/691] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:51.713317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.780296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:51.826206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 337/692] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:51.827480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:51.945924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b174-efd6-4b02-a425-26f96ff8b5f6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.970183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871b57-f84f-4f48-a4e6-99c2dafdf5a6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:51.985657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:51.986805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:51.987312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:51.987783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:51.999090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.000873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:52.021120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:52.022056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:52.023072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:52.023072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:52.023072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:52.023072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:52.025429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 338/693] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:52.030959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.060645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.092853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.093501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.093787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.094061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.094922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:52.095231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.100101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.134446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 356/694] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:27:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:52.141865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.162743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c2ea8-df4c-43cb-96d7-f5cc8ea88c51 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.205255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.214514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.215745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.216030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.216421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.217059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:52.217371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.218736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb5dc-7283-41b1-95a7-5385d36b4123 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.232187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 339/695] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:52.236922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389ed6-c5bc-41db-b352-a8d16a5cbe89 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.236922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389ed6-c5bc-41db-b352-a8d16a5cbe89 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.236922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389ed6-c5bc-41db-b352-a8d16a5cbe89 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.239672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 340/696] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:52.240756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389ed6-c5bc-41db-b352-a8d16a5cbe89 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.299869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b67ef0-9bf5-44d1-aa2c-69b9b67311ac None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.332409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.353587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.354469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.354766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.355360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.359222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389ed6-c5bc-41db-b352-a8d16a5cbe89 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.413009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.413876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.414163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.414445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.424825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.427039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.432500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.434051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-070500ef-5977-4364-a9b0-7a89b896c2cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:52.444952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:52.445854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:52.446741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:52.447160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 341/697] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:52.451086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.451086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.451086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.471324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.472129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:52.474129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:52.551957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 357/698] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 13:27:52.553265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.576076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 342/699] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:52.576076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.657596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.686710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d331b6-5d81-4d84-a20b-7e76b5f536d4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.706717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d864a9-9815-4d64-84ac-29e1bab96342 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.727233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.728134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.728421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.728698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.729781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:52.730445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.732552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.736460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.750871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 358/700] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:52.751818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.757667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.758618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.759003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.759386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.775467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.777945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:52.804138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:52.806195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:52.808312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:52.808312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:52.808312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:52.808312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:52.808312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 343/701] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:52.809169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.873678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab7f8-f796-4961-b998-9e72281ff5eb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.926527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.927450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.927737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.928010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.928569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055dcb-e7df-45a0-b088-5599f82c519d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:52.943188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.945710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.951213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:52.967226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:52.967991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:52.968376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:52.968657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:52.969540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=a20d31e9b69d4807a3e31f796fca6274) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:52.969862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:52.970723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:52.972127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:52.973173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:52.973173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:52.973173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:52.973173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:52.973403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:52.975720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 359/702] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:52.976717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:52.984385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 344/703] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/role_assignments?user.id=a20d31e9b69d4807a3e31f796fca6274&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:52.985581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:53.044039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:53.104311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25bc5-304c-4851-8a6c-4d4a7f9c2410 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.132166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddf251-e255-420e-994e-a27bed6b6413 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.175934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.176633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.176931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.177214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.177967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:53.178280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.179706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:53.196445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 345/704] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:53.205198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:53.206995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.207694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.207978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.208285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.209026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:53.209332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.210742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:53.241498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 360/705] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:53.244179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:53.309719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:53.383609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb459bb-4568-4875-a819-b62cfd34a32e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.409270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7657d6-1efd-48fd-b176-9f424a541cb1 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.423598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:53.430653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f990ca-bffd-448d-b166-917593e54f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.431349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f990ca-bffd-448d-b166-917593e54f42 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.431635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f990ca-bffd-448d-b166-917593e54f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.436398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f990ca-bffd-448d-b166-917593e54f42 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.436398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f990ca-bffd-448d-b166-917593e54f42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.436398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f990ca-bffd-448d-b166-917593e54f42 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:53.459502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.460344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.460632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.460912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.468493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.469964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:53.485412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:53.494713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 361/706] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:53.496351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:53.519569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 346/707] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:27:53 2022] POST /identity/v3/users => generated 254 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:53.605057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f88fc6-8a5a-4c52-9312-c244481e445a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.605387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f88fc6-8a5a-4c52-9312-c244481e445a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.606230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f88fc6-8a5a-4c52-9312-c244481e445a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.609036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 347/708] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:53.617632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.618316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.618819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.619489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee4bd4-d0a0-4df7-aa62-bee818713cec None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.642762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:53.644405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:53.664354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.665451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.665980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.666467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.667469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:53.668043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.669840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:53.684932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 362/709] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:27:53.690723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:53.744604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:53.788155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 348/710] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:53.807215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:53.837546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36042b5-5da1-4a4a-8c9d-29b90fceb43f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.849616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:53.881220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.882975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.884196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.884681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.885796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=796757d15819413f8486471e778d95a6) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:53.886310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.888290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff241c-2208-46ba-bc31-1340719b0e6f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:53.895824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 363/711] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:53 2022] GET /identity/v3/role_assignments?user.id=796757d15819413f8486471e778d95a6&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:53.939045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d742f8-d275-4203-be6b-728cf68f0dda None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:53.961111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377d4e-e891-4cec-ac1e-56beed4bf932 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.961749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377d4e-e891-4cec-ac1e-56beed4bf932 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.962227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377d4e-e891-4cec-ac1e-56beed4bf932 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.964171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 364/712] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:53.971916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.972645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.972645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.981259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:53.982330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:53.982618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:53.982894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:53.983574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:53.987597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:54.003462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:54.004922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:54.005987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:54.006931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 349/713] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:53 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:27:54.008371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:54.013536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:54.149628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 365/714] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:54.189630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:54.192024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:54.205909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39107d-a1ee-4a33-9aa3-7b661f72e6d6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:54.227754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:54.259713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:54.260857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:54.261355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:54.262348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:54.263481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] RBAC: Adding query filter params (name=network) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:54.265052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:54.266671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:54.278372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 350/715] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:27:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:54.284389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:54.385441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3cde-421a-4655-9a44-42efff9fb5ec None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:54.437973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:54.438793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:54.439074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:54.439345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:54.439993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:54.441399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:54.455601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:54.456599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:54.457643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 366/716] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 8 13:27:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:54.465402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:54.480810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba656d-c438-4cf8-84d7-713526411798 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:54.556044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:54.556740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:54.557023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:54.557300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:54.558018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] RBAC: Adding query filter params (type=network) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:54.558325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:54.562777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:54.574917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 351/717] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:27:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:54.632522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:54.650466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb681e3f-769e-40a4-a042-ebf86e609f1e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:54.699140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:54.700494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:54.700782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:54.701060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:54.701838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:54.702159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:54.703853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef439-6073-41d2-b1e9-d42be1b224eb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:54.709346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 367/718] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 8 13:27:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:54.716297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:54.752682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:54.844900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81f97-7dad-4d2c-9838-e2e7973c8e08 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:54.882777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:54.883446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:54.883726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:54.883998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:54.884738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:54.885043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:54.886416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3da27-fd4f-4e83-9d40-9c693e747b42 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:54.892065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 352/719] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 8 13:27:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:56.111382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe214-6497-4e7a-84e7-a4227724c435 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.112348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe214-6497-4e7a-84e7-a4227724c435 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.112850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe214-6497-4e7a-84e7-a4227724c435 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.115190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 368/720] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:56.120539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.121573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.122254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.151425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:56.153510 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:56.242486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 353/721] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:56.283392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe214-6497-4e7a-84e7-a4227724c435 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:56.436913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe214-6497-4e7a-84e7-a4227724c435 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:56.485678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:56.486489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.486765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.487032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.501991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:56.509603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:56.510525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:56.511894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 369/722] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:56.519422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:56.548327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:56.640741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1ed5-f7c7-475f-bb2d-a73c981fd4ff None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:56.678271 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:56.679374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.679877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.680377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.681348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:56.681852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:56.683649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516f4b4-65f1-43f0-85f4-60689102cc97 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:56.693157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 354/723] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:56.704078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:56.709923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1594-e4e5-4ef1-9f09-13ca594a72ba None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.710213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1594-e4e5-4ef1-9f09-13ca594a72ba None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.710489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1594-e4e5-4ef1-9f09-13ca594a72ba None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.713345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 355/724] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:27:56.719225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c996c9-151e-4114-8c51-a298b13feb4b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.719712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c996c9-151e-4114-8c51-a298b13feb4b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.720172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c996c9-151e-4114-8c51-a298b13feb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.728400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:56.748138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-02c996c9-151e-4114-8c51-a298b13feb4b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:56.750577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-02c996c9-151e-4114-8c51-a298b13feb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:56.835509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e550db-09f6-42ae-b5e6-385a9d842fc9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:56.851136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 356/725] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 13:27:56.851136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb100e5-a4a7-4133-b0a9-2b09fbbf1223 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.851136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb100e5-a4a7-4133-b0a9-2b09fbbf1223 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.851136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb100e5-a4a7-4133-b0a9-2b09fbbf1223 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.855782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 357/726] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:56.857458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.857755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.858036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.877671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:56.879011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:56.881775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:56.896848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:56.897653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:56.897937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:56.898213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:56.911228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:56.912742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:56.937033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:56.938017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:56.938957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:56.938957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:56.938957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:56.938957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:56.939375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 370/727] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:56.940287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:56.979020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 358/728] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:56.989170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.020492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.060642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d0eb2-cb69-4708-9456-b97f0f756d30 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.104079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.104079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.104079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.104079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.110843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:57.113239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3545c5-a4eb-486f-977e-578033dbad68 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:57.119036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:57.120361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 371/729] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:57.121824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.151399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.152424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.152959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.153220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.153951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:57.154263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.155866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.163112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.170371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 359/730] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:57.171209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.232537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b015-3a63-4930-87bd-6eee7298a83c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.302056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.310901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f6c58-fd49-4d12-a171-2cc51fe8b462 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.314661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.315460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.315743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.316017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.327912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:27:57.335895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:57.337040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:27:57.338079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:57.346367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 372/731] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:57.347159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.354788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.355736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.356157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.356445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.357196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:57.357556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.358941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baae4f-1d0b-492c-8f82-5fd5926a06ba None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.372004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 360/732] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:57.373394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4464-980e-44ff-8f8e-efcc34b01248 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.373686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4464-980e-44ff-8f8e-efcc34b01248 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.373969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4464-980e-44ff-8f8e-efcc34b01248 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.375257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 361/733] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:57.375952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4464-980e-44ff-8f8e-efcc34b01248 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.449110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.459959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f476a5-86d5-4005-9422-264c56d02b07 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.493298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4464-980e-44ff-8f8e-efcc34b01248 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.500419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.501521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.502049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.502627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.510574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.512631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.527801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:57.528004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:57.529104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:27:57.530075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:57.530631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.530631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.530631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.530631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:57.530631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.531457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941e28-8ce8-4f48-b91e-5746ac1d6bec None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.533624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 373/734] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:57.534355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.545481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 362/735] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:57.545481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.545481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.545481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.559994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:57.561543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:57.583926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.636089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 363/736] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:57.636089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.654571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d9043-b352-44d8-97fb-ea49cf182639 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.691565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.692499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.692893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.693190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.695915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.704197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.705682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:57.723881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:57.725034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:57.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:57.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:57.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:57.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:57.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 374/737] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:57.725954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.751523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b0bde-0a76-4937-abcd-f841d92129b7 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.785126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.785798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.786336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.786613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.787453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:57.787763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.789224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.806662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 364/738] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:57.807536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.818578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.825483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb8c8e-cd55-4c26-91fc-dce307f2497c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.860689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.861483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.861767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.862039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.872237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.873702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:57.891539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:57.892487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:57.893389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:57.893389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:57.893389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:57.893389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:57.893389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 375/739] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:57.893674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:57.906987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ce8f-aa23-4440-bc33-f786890811b8 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:57.918762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:57.941792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:57.942615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:57.943171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:57.943449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:57.944197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:57.945946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:57.991186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840bd6c-f3a2-489e-b3db-ac19ebcf745c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.025156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.025748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.026023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.026294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.027565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:58.027948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.029328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a9d1e-afb5-4dcd-b598-3adbc3f67165 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.040557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 376/740] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:58.041834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b85f-71ee-40e0-9a26-bdce3c537918 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.042122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b85f-71ee-40e0-9a26-bdce3c537918 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.042444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b85f-71ee-40e0-9a26-bdce3c537918 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.043676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 377/741] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:27:58.044389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24b85f-71ee-40e0-9a26-bdce3c537918 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.053198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.061487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 365/742] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:27:57 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:58.062319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.173332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24b85f-71ee-40e0-9a26-bdce3c537918 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.180935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4104-69f9-439e-b944-5ddea87d8558 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.213105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaa698-09e3-448a-81bb-6f644438bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.213996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaa698-09e3-448a-81bb-6f644438bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.215054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaa698-09e3-448a-81bb-6f644438bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.215541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaa698-09e3-448a-81bb-6f644438bd94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.217407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.218087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.218369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.218650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.219382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:58.219688 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.221116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.239355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 366/743] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:58.240422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.280772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.299277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aaa698-09e3-448a-81bb-6f644438bd94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.300766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aaa698-09e3-448a-81bb-6f644438bd94 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.302615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.356813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee40c6e-97f5-459f-90ec-a4d05c5fa081 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.395417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.396394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.396674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.396953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.404837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.406377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.411227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 378/744] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 13:27:58.412583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.412869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.413141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:58.425830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:58.426809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 367/745] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:58.432778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.433683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:27:58.433683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:27:58.503099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 379/746] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:27:58 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 13:27:58.503940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.539450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.549711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725786d-d980-4b46-8c7d-323fa92f7390 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.553625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.586492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.587350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.587690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.587969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.596461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.597909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:27:58.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:58.613756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:27:58.614692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 368/747] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:58.615275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.630352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d49e3-2a51-40e4-a6bc-f34cb0e586b7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.671398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.672219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.672503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.672778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.683621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.685269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:58.705308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:58.706237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:58.707129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:58.707129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:58.707129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:58.707129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:58.707129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 380/748] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:58.707810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.733197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3b73-bb26-49f6-9a34-fb92b799cade None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.768673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.769350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.769635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.769925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.770767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:58.771066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.772542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.793361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 369/749] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:58.794539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.800528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.808864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:58.817853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a47cf-f090-427d-9c28-1015d75c4209 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.855880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.857032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.857322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.857601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.862207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.862207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.910168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f27e84-5f71-4647-b0a3-72138fa2e17c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:58.944253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 381/750] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:27:58 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:27:58.945663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:58.963999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:58.965223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:58.965689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:58.966141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:58.967492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:58.968135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:58.969894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:58.992907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 370/751] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:58.994159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.082132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47537ad3-b2b0-4fd9-ad35-52d6901b8fca None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.093703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.122701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.123704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.124265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.124806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.125809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:59.126315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.128046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.146627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd0165-4a5f-47c0-a1a9-95e6ef3c74e0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.147045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 382/752] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:59.148141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.154250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.195279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.196013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.196329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.196605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.293900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.295541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.299069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1c6a-8920-45eb-8a69-88ed448d80f8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.347831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.349287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.350363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.350854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.366196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.366863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.369740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:59.390709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:59.391685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:59.392971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:59.392971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:59.392971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:59.392971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:59.399258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 383/753] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:59.400429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.411072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 371/754] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:27:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:27:59.411997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.461213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.507161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7827-4a07-45ea-be5d-8bf2ef55facd None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.523307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13daf0-bfa4-4405-997c-36dd94c0d01a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.550396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.551351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.551730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.552134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.560313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.561893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.570261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.571018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.571370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.571717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.572549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:59.572924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.574874 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:27:59.577735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:59.578820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:27:59.580012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:59.581684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 384/755] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:59.585307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.594864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 372/756] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:59.595733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.629306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.711482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ada46-e6e6-4cf0-9fb7-6da6331a6884 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.731602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.732900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d36ddf-d389-4f1e-8c2f-5d68d9b27bfa None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.755395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.757450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.757939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.758429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.770609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.772390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.775687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.777381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.777828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.778214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.779058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:59.779380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.780939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:27:59.794341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:27:59.795321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:27:59.796886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:27:59.796886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:27:59.796886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:27:59.796886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:27:59.797113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 373/757] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:59.797113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.798916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 385/758] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:27:59.804957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:27:59.900088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:27:59.922613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9063f-8048-4516-9d29-d5f636b902ec None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.927443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739483-ea97-4c7f-9ddc-9140eb4b9fee None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:27:59.967215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.968420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.969118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.969401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.974274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:27:59.974939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:27:59.975222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:27:59.975499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:27:59.976497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=a20d31e9b69d4807a3e31f796fca6274) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:27:59.976958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.977390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:27:59.978401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.978877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:27:59.985594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 386/759] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/role_assignments?user.id=a20d31e9b69d4807a3e31f796fca6274&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:27:59.986587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:00.006173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:00.007168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:00.008514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 374/760] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:00.014734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.066076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:00.230679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24757d8-6b31-436e-8aee-125d4cbe39a3 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:00.238674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e72b5-8032-4ceb-85a3-ba917e1cd6cd None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:00.335169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:00.335902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.336218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.336497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.337481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:00.337794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:00.339871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:00.354662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 375/761] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:00.361060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.362785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:00.363971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.364445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.364868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.365755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:00.366112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:00.366380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:00.368394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:00.393155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 387/762] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:00.400384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.497621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3c2be-1b88-48f5-ae2b-b2bc4b404860 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:00.509662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178098fd-7082-48d5-ab96-b5336ab5bad1 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:00.513553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:00.543966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c9f6c-3580-4e79-8e7b-e45a07c39a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:00.545416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c9f6c-3580-4e79-8e7b-e45a07c39a56 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.545746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c9f6c-3580-4e79-8e7b-e45a07c39a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.546033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c9f6c-3580-4e79-8e7b-e45a07c39a56 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/796757d15819413f8486471e778d95a6/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.549274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c9f6c-3580-4e79-8e7b-e45a07c39a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=796757d15819413f8486471e778d95a6, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:00.550713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c9f6c-3580-4e79-8e7b-e45a07c39a56 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:00.551772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:00.552712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.553244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.553614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.562027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:00.563549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-7fe4eccb-fc7d-476c-84de-7a48087de570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:00.578041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:00.579023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:00.579944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:00.584143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 388/763] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:00.584143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23789ff-ead0-4db4-af99-8c69b94721ce None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.584143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23789ff-ead0-4db4-af99-8c69b94721ce None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.584143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23789ff-ead0-4db4-af99-8c69b94721ce None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.584143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 389/764] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:00.588108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23789ff-ead0-4db4-af99-8c69b94721ce None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.636800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 376/765] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:00 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/796757d15819413f8486471e778d95a6/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:28:00.638617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.639522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.640139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.678174 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:00.679682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:00.775094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23789ff-ead0-4db4-af99-8c69b94721ce None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:00.788347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:00.807781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 377/766] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:00.834769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.863827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:00.864682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:00.865039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:00.865446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:00.866342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:00.870419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:00.873575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:00.896793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 390/767] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:00.903421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:00.926281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:01.018338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409c015-f0b6-440f-b2aa-240fad4763a6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.020977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dde16-3197-4ce9-a405-c79d86b74cc0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.054900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.055644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.056023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.056430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.057365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=19ce6d63072e4822aa4e4da5371d7090) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:01.057872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.059601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.066449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 391/768] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:00 2022] GET /identity/v3/role_assignments?user.id=19ce6d63072e4822aa4e4da5371d7090&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:01.102579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.103425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.103710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.103993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] PATH_INFO: `/v3/services/network` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.105274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.106711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:01.124867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:01.126102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:28:01.127127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:01.132598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 378/769] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:00 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:01.143709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:01.240651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:01.266739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043743c7-d218-4367-a1c5-1cc4e3551e24 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.309523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.310213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.310495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.310768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.311482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] RBAC: Adding query filter params (name=network) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:01.311780 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.313350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe11361-cc56-4d54-b229-c7de3f0ed919 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.318714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 392/770] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:01.325146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:01.389372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:01.452937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522cb5-40eb-4cee-aca9-5a168c3e9847 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.497961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.498643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.498820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead12ee-8193-428c-abdb-003e57d0e53d None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.499272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.499352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead12ee-8193-428c-abdb-003e57d0e53d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.499423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.499491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead12ee-8193-428c-abdb-003e57d0e53d None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.499904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] RBAC: Adding query filter params (type=network) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:01.500241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.501009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 393/771] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:01.501616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.505877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.506225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.506509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.512840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 379/772] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:01.518406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:01.523875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:01.525304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:01.596070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 394/773] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:01.619386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:01.707416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:01.728473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd600b01-56ad-4ef1-80b9-d7379da471c4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.769692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.770698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.770984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.771260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.771916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.773406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:01.787438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:01.788424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:01.789268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 395/774] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:01.795430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:01.797964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416804f2-8eb2-4f21-b8b0-4242cd6f2188 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.848537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:01.891592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.892488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.892777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.893055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.893858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] RBAC: Adding query filter params (interface=public, service_id=babe3dd452c3427b89275e6d9561fbb0, region_id=RegionOne) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:01.894175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.895679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.907823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d8eea-6bf8-4799-b743-b9384740b624 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:01.917896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 380/775] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/endpoints?service_id=babe3dd452c3427b89275e6d9561fbb0&interface=public®ion_id=RegionOne => generated 194 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:01.923545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:01.948584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:01.949576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:01.949916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:01.950192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:01.950961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:01.951269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:01.953119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:01.958409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 396/776] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:01.960386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:01.965254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:02.083391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332b2b-34fd-4d62-93c8-b8ae6e4ae5b0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:02.152210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:02.152863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.153146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.153425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.154159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:02.154467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:02.155909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:02.159714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb901-7d91-43ed-9557-ef708c7e2f2a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:02.178448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 397/777] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:02.181102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:02.256283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:02.264776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:02.265544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.265901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.266248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.267006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:02.268532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:02.282974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 381/778] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:01 2022] GET /identity/v3/services => generated 772 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:02.303479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1a054-4348-4715-94a7-7915b837436f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:02.349896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:02.350893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.351361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.351918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.352914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] RBAC: Adding query filter params (interface=public, service_id=53f34cb8fed54578a4cb3300d43ff442, region_id=RegionOne) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:02.353410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:02.355627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed572a6-efa6-42de-9100-d676f5c7799e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:02.365220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 398/779] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:02 2022] GET /identity/v3/endpoints?service_id=53f34cb8fed54578a4cb3300d43ff442&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:02.371520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:02.462942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:02.545396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95e3e-9118-4a57-8b66-ea3c7bccc168 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:02.580035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbc349-bde7-44ad-a3ce-9e62690de832 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.580590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbc349-bde7-44ad-a3ce-9e62690de832 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.580680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbc349-bde7-44ad-a3ce-9e62690de832 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.582131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 399/780] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:02.587376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.587671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.587955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.588191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:02.588906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.589186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.589466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.590149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:02.591523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:02.597188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 382/781] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:02 2022] GET /identity/v3/services => generated 772 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:02.616013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:02.617670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:02.709398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 400/782] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:02.751203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:02.878268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bfec-4dd4-407f-9fc7-24888cc58a21 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:02.896810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:02.921887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:02.922695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:02.922980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:02.923249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:02.939211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:02.947043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:02.948600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:02.949976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:02.954140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 383/783] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:02.960310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:03.067625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:03.133357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db69a3-c433-4843-8804-444d522fc831 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:03.177062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:03.177746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.178029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.178306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.179058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:03.179367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:03.180782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:03.193303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 401/784] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:03.198980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:03.355662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c09bb-1bad-4650-ae17-b4434e1ed35c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:03.409488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:03.410322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.410858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.411130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.435195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:03.436730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-07c42406-99a2-4c88-babd-5ac57ff3b2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:03.459481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:03.461811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:03.464905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:03.464905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:03.464905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:03.464905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:03.464905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 384/785] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:03.472091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:03.642930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac0057-88b8-437a-a189-f7a80e34c0dc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:03.665016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:03.688886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:03.689561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.689846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.690122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.690856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:03.691166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:03.692580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:03.695056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf85aa5-f289-4862-aeb5-ce0a564e9135 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.695595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf85aa5-f289-4862-aeb5-ce0a564e9135 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.695934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf85aa5-f289-4862-aeb5-ce0a564e9135 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.697653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 385/786] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:03.705771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f94ce7-f97c-4eb3-b4a8-418afa30fe75 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.705771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f94ce7-f97c-4eb3-b4a8-418afa30fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.705771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f94ce7-f97c-4eb3-b4a8-418afa30fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.715604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 402/787] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:03.719652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:03.730470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e7f94ce7-f97c-4eb3-b4a8-418afa30fe75 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:03.731676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e7f94ce7-f97c-4eb3-b4a8-418afa30fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:03.755634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:03.823138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 386/788] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:03.824515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2ab1-e0a1-448d-a32d-0ec8ebda98f7 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.824808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2ab1-e0a1-448d-a32d-0ec8ebda98f7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.825088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2ab1-e0a1-448d-a32d-0ec8ebda98f7 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.826600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 387/789] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:03.831744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.832033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.832344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.849828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:03.851028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:03.873201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90866b97-3c69-4537-9f14-98dc6ce085be None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:03.914980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:03.915697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:03.915980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:03.916294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:03.923783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:03.923936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 388/790] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:03.924764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:03.925355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:03.941581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:03.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:03.943504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 403/791] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:03.949496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:03.994308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.060329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.061617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e826-3ce2-4db6-acea-d54f81e67a1b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.085061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f134e5-c305-4869-8b2d-164139654d2e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.111108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.112209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.112661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.113081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.114131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:04.114712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.116472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.135738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 404/792] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 8 13:28:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:04.137232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.138275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.138742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.139201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.141860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.152749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:04.161409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:04.162325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:04.163196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 389/793] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:04.163871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.245028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.251167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e684a1-d036-4f45-a985-404216fffa2b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.279508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42089dc-79ca-4ef5-a63a-a48052bf31db None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.286901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.287898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.288299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.288670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.299811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:04.307698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:04.308769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:28:04.309611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:04.314388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 405/794] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:04.315278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.320621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.321642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.322110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.322562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.334727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.336434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.339923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:04.356659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:04.357576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:04.358493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:04.358493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:04.358493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:04.358493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:04.365213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 390/795] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:04.366344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.419548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7abc4-cb33-4e90-b50d-3cb801031133 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.454781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.455504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.455872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.456243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.457048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:04.457420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.458872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.467641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 406/796] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:04.468610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.480384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10286f-a6d0-4734-a33e-b793199dbbe4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.487593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.523110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.524153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.524625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.525088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.526068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:04.527207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.528818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.538674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 391/797] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:04.539757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.579974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ff578-e22c-404d-bdf0-8e77f299332f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.602403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.615749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.616628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.616914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.617184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.617900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:04.618204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.619617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.642285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 407/798] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:04.642285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.656371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a7da-7ab0-4b04-95a7-5de48a4960f3 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.700342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.701572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.701858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.702136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.717967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.719604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.740553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:04.742854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:04.743744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:04.745241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:04.745241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:04.745241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:04.745241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:04.748127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 392/799] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:04.764021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.778054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c22ee8-2b9c-49f5-95ed-99e11bf17298 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.828789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.830604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.831098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.831946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.846452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.849114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:04.875063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:04.876083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:04.876987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:04.876987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:04.876987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:04.876987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:04.876987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 408/800] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:04.877718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.886725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9b8c0-adbe-407a-922d-2236777b753d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:04.902720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:04.933518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:04.934818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:04.935375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:04.935982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:04.945344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:04.947441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:04.964913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:04.965854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:04.966765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:04.973839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 393/801] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:04.974994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:04.990072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a0e1f-65cb-494f-b8ed-6191a4cea4f7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.019121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.024884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.025560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.026410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.026692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.027670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:05.027783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.038415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.045576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 409/802] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:05.046490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.096547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9b55-cbc3-4609-99e4-7c554ed89b6b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.139408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.140471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.140860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.141270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.142110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:05.142942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.144186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.155281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a5a0-21c6-469d-8669-2220afeca1b1 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.158528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 394/803] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:05.159613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.191806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.192751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.193183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.193600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.194559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:05.195074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.195190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.196840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.210740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 410/804] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:05.211917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.266877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.279098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5410749-ee33-47b2-a071-f33c21cdf42f None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.314595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.315390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.315675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.315952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.316428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d47b8-c3aa-4262-a326-8d64c896f827 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.323611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.325081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:05.339354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:05.340539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 395/805] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:05.341506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.352962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.353774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.354742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.354951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.362239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.363691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-9dc41a6e-438c-45af-bd00-a42b0d2cc653 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:05.379016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:05.380207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:05.381184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 411/806] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:05.381783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0a0b2-8e91-4f3f-abf6-2d5b46c200cc None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.381783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0a0b2-8e91-4f3f-abf6-2d5b46c200cc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.382709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0a0b2-8e91-4f3f-abf6-2d5b46c200cc None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.383334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 412/807] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:05.388253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347032c8-31bc-47ed-9601-3af025648080 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.388253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347032c8-31bc-47ed-9601-3af025648080 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.388253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347032c8-31bc-47ed-9601-3af025648080 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.388253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 413/808] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:05.388253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347032c8-31bc-47ed-9601-3af025648080 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.433973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.443164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271fe4e-c256-4998-add1-8832b4f75f32 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.477956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.478962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.479292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.479575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/a20d31e9b69d4807a3e31f796fca6274/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.481629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=a20d31e9b69d4807a3e31f796fca6274, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.483042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.489988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347032c8-31bc-47ed-9601-3af025648080 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.500554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.523298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.523961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.524279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.524588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.525412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:05.526483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.527937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943f78-8802-40a5-a3ac-b7c003e8fd66 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.545209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 396/809] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:05 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/a20d31e9b69d4807a3e31f796fca6274/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:28:05.550560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 414/810] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:05.550749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.550845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8763ed2-a9f5-4e9e-88c6-e5ab741de549 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.550845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8763ed2-a9f5-4e9e-88c6-e5ab741de549 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.550845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8763ed2-a9f5-4e9e-88c6-e5ab741de549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.573833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a8763ed2-a9f5-4e9e-88c6-e5ab741de549 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:05.575161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a8763ed2-a9f5-4e9e-88c6-e5ab741de549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:05.668291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 415/811] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:05.669816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.670127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.670393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.691265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da63-fb06-4e31-9959-77ef13a2c7dc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.699442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:05.700718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:05.733859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.734550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.734837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.735116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.736986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:05.738005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.739914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.762601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 397/812] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:05.763329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.774348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.780257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 416/813] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:05.780257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.816367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:05.879377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8fc2-5733-490e-81ac-a198f9c19762 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.899114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d7b8-dcca-4d05-a84b-1efdb49a68d3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:05.917823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.918486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.918764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.919164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.937598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:05.938404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:05.938697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:05.938974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:05.939664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.941037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:05.953842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:05.954852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:05.955695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 417/814] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:05.956985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:05.996823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:05.999056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.011788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.064809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.075903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfd1e-2c50-423a-bcf5-5b2bf79748b7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.115243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 398/815] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:06.116133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.125914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.126971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.127467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.127924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.140744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.142417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:06.160778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:06.161822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:06.162907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:06.162907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:06.162907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:06.162907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:06.164529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 418/816] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:06.165410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.230034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3b262-13f1-4aea-bdb7-df27ab310c05 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.240604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.270553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274fa5-5bca-4464-9385-fc5d8acd4a00 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.271093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.272064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.272372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.272655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.274111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.275482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:06.292096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:06.293390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:06.299458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 399/817] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:06.300341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.305692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.306365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.306649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.306991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.307710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:06.308007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.309404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.318667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 419/818] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:06.318667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.326842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.411308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025977f3-d9fa-4163-bcad-0c080ae2ff0a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.426355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc838-402c-421e-b924-cf8d6975c0e7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.446464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.447268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.447686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.447963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.459670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.461162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.461941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.462602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.462919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.463688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.464440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:06.464883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.466099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.483114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 420/819] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:06.483114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:06.483364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:06.484559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:06.485454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:06.485454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:06.485454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:06.485454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:06.485454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 400/820] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:06.485454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.517729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.568672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.597070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab620-229c-4ee7-8fc5-4127ac05d335 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.604763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44990a-eec3-42e7-ad40-97052a456c83 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.634850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.635715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.636002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.636310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.637014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] RBAC: Adding query filter params (type=network) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:06.637317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.638698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.640981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.641704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.641995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.642258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.642960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:06.643262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.644441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 401/821] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:06.644651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.645600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.654583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 421/822] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:06.656480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.756784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfbeb9-8c1f-4619-b96f-529e95278f19 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.769079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bf92e-54ac-4b52-8220-446ca2353b1b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.793218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.794087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.794385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.794665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.803075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.804724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.805593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.806335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.806693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.806977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.807134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.808247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:06.812554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.812554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.821239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 422/823] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:06.822028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:06.822255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:06.823930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:06.825122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:06.827267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 402/824] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:06.828415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:06.835061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:06.937871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2302-38ef-41b1-96c5-6a4541f780f0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.938267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e44480-7e16-4efb-b986-b96bae34febd None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:06.974898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.975106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:06.975585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.975696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:06.975874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.975985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:06.976198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.976292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:06.976871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:06.976973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.977180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:06.978257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.978527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:06.983991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 403/825] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:06.989614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:07.004318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:07.071625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 423/826] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:07.082611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:07.105318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c786-b9b3-4ade-b23f-c74ff071b97d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:07.154783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:07.155964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.156638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:07.157677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.158256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.167244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:07.169640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:07.185926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:07.187060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:07.188148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:07.195035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 404/827] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:07.196255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:07.234468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee9e23-7832-4209-884a-2e8ec5b0ae67 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:07.279032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:07.279783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.280092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.280379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.280628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:07.281410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:07.281533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:07.283933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:07.307414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 424/828] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:07.307414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:07.336244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a6d09-5775-418f-be62-9540354bec08 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:07.388411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:07.389472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.389984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.390353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.392739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:07.392739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:07.429690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8697f-27c6-4d68-a39e-ece47face11d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:07.441192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:07.466098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:07.466809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.467087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.467366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.468181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:07.468491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:07.470066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:07.480915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 405/829] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:07.482214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:07.498677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 425/830] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:07.506385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:07.624944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364e59a-8ca4-43ed-812e-af04345100ba None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:07.640666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57692-8960-4741-8ea2-9ee8e73d1fe9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:07.650241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:07.668170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffd4d8-edc1-4117-a10d-2f95ef7da720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:07.669529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd4d8-edc1-4117-a10d-2f95ef7da720 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.670116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd4d8-edc1-4117-a10d-2f95ef7da720 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.670702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd4d8-edc1-4117-a10d-2f95ef7da720 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/19ce6d63072e4822aa4e4da5371d7090/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.689851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffd4d8-edc1-4117-a10d-2f95ef7da720 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=19ce6d63072e4822aa4e4da5371d7090, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:07.690213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:07.690782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.691063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.691333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.692196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=796757d15819413f8486471e778d95a6) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:07.692507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:07.693247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffd4d8-edc1-4117-a10d-2f95ef7da720 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:07.693947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0fa3f-549a-41c5-a69b-4d2adf0e10e4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:07.702035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 426/831] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:07 2022] GET /identity/v3/role_assignments?user.id=796757d15819413f8486471e778d95a6&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:07.783652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 406/832] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:07 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/19ce6d63072e4822aa4e4da5371d7090/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:28:07.845332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f227a79-b162-4f60-8bda-2ec286a90a4e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.845894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f227a79-b162-4f60-8bda-2ec286a90a4e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.845894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f227a79-b162-4f60-8bda-2ec286a90a4e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.847595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 427/833] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:07.853215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:07.854099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:07.854436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:07.874777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:07.876139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:07.958637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 407/834] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:07.983502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f227a79-b162-4f60-8bda-2ec286a90a4e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:08.022256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:08.110971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f227a79-b162-4f60-8bda-2ec286a90a4e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:08.154733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:08.155470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:08.155801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:08.156093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:08.168184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:08.175903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:08.177077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:08.178233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 428/835] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:08.184022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:08.284495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:08.287590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fcfe-0fa3-460e-b823-82f2a097b457 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:08.327599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:08.328415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:08.328770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:08.329113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:08.329933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:08.330303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:08.331741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:08.341763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 408/836] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:08.347236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:08.446755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:08.455921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bf13f-b879-4291-b33f-cde7c82b7e3f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:08.492147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:08.492949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:08.493228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:08.493499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:08.504167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:08.505617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:08.524033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:08.524979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:08.526844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:08.526844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:08.526844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:08.526844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:08.529215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 429/837] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:08.535237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:08.640783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0943a2e-4db1-448b-9604-54808f6de7fb None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:08.676914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:08.677576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:08.677854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:08.678124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:08.678839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:08.679140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:08.680537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:08.693602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 409/838] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:08.699649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:08.805028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801890b-6024-4776-bc6a-52cd0783d63e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:08.840343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:08.841241 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:08.841522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:08.841797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:08.849142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:08.850591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:08.865367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:08.866365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:08.867339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 430/839] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:08.874769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:08.904819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:08.988453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2870e-cb4b-445a-bf87-1074ea7af54a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:09.025922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:09.026837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:09.027123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:09.027396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:09.028276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:09.028588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:09.030034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:09.048503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 410/840] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 8 13:28:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:09.054036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:09.058863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:09.170023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aa32-8c1d-48cd-add7-3f653e85a064 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:09.205456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:09.206448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:09.206947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:09.207426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:09.284194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:09.284194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:09.287444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:09.386141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 431/841] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:09.391903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:09.476891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:09.497112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67dd9e-fd4b-4204-b1ae-6bb02e3be20a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:09.532436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:09.533235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:09.533513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:09.533790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:09.545210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:09.546589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:09.564664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:09.565606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:09.566503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:09.566503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:09.566503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:09.566503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:09.566503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 411/842] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:09.573023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:09.680951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e98d3-14cf-4591-849a-a9f1ec66b12c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:09.683779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:09.718098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:09.718768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:09.719049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:09.719325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:09.720070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:09.720380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:09.721748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:09.735061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 432/843] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:09.740718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:09.850461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bfa2d-91ec-430f-a38e-db207ffd4298 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:09.882093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:09.888767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:09.889591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:09.890124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:09.890403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:09.897420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:09.898855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-4cfdb08d-ea81-419b-bac3-c2ee69010951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:09.913595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:09.914512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:09.915407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 412/844] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:09.920697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.018756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34273-a621-486c-bc40-43cf2e02242c None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.019134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34273-a621-486c-bc40-43cf2e02242c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.019346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34273-a621-486c-bc40-43cf2e02242c None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.022474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 413/845] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:10.028005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e75343-e1a7-4958-96d2-6a79cd3d672d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.028337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e75343-e1a7-4958-96d2-6a79cd3d672d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.028618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e75343-e1a7-4958-96d2-6a79cd3d672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.046348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4c000-9165-4a5c-97f2-7e6f810cffa8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.047880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-56e75343-e1a7-4958-96d2-6a79cd3d672d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:10.049266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-56e75343-e1a7-4958-96d2-6a79cd3d672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:10.086305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.087470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.088943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.089493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.090651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:10.091251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.093245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.109007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 433/846] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:10.118055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.128815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 414/847] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:10.130259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144c45-58e0-4df6-8b18-1826256388c0 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.130549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144c45-58e0-4df6-8b18-1826256388c0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.130823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144c45-58e0-4df6-8b18-1826256388c0 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.132341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 415/848] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:10.139040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.139330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.139773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.147637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.157947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:10.159145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:10.230540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19739a78-0bdc-488d-b012-9abf38fddbe1 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.232390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 416/849] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:10.239234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.266444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.267099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.267376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.267645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.268493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=a20d31e9b69d4807a3e31f796fca6274) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:10.268798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.270222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.276622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 434/850] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/role_assignments?user.id=a20d31e9b69d4807a3e31f796fca6274&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:10.277472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.340155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.380208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.382880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a2659-2d6b-45ef-958e-975acd835def None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.394414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6c53-ef94-4b21-a73f-7133a0bd4aa4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.423651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.424517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.424803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.425081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.425748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.427206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.434989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.435822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.436133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.436410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.437071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.438498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-28b9a64b-3fbb-4240-8ba8-23194d340ee9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:10.440840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:10.441888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:10.442762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:10.447594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 417/851] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:10.449240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad37834-f769-45cb-80f0-6d4a09b4d483 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.449532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad37834-f769-45cb-80f0-6d4a09b4d483 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.449812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad37834-f769-45cb-80f0-6d4a09b4d483 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.455705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 418/852] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:10.455705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad37834-f769-45cb-80f0-6d4a09b4d483 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-605747be-daf4-4c35-8b1a-2b880638b53b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:10.456230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:10.458583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:10.461761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 435/853] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:10.464588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f70a-9f62-4747-840a-304265049355 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.464588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f70a-9f62-4747-840a-304265049355 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.464588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f70a-9f62-4747-840a-304265049355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.483411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e487f70a-9f62-4747-840a-304265049355 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:10.484675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e487f70a-9f62-4747-840a-304265049355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:10.562461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 436/854] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:10.564185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f70a-9f62-4747-840a-304265049355 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.573421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad37834-f769-45cb-80f0-6d4a09b4d483 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.592579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.610430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.611466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.611592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.611887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.612576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:10.618617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.618617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.623426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 419/855] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:10.623426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.664972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.685725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f70a-9f62-4747-840a-304265049355 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.728727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.729631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a125d-0474-4dfc-90a0-4794a73ae01e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.729744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.729927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.730197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.730888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:10.731357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.743381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 437/856] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:10.743381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.770174 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.770966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.771248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.771523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.783353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:10.791501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:10.792681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:10.793560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 420/857] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:10.794277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.839114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.857585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e220f-fe53-4fda-9bdc-206b622cebc0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.894517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.895212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.895491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.895761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.896487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:10.896789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.898168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.902326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144d827-ba99-47b1-9872-d66ba4a70099 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:10.903628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 438/858] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:10.913670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:10.936292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:10.946783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:10.947704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:10.950333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:10.950333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:10.950635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:10.951048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:10.952837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:10.968008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 421/859] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:11.053920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8497a5-19b7-4a4c-881e-87ce9f8c2e98 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:11.100159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:11.100159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:11.100159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:11.100159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:11.100577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:11.100733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:11.102131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:11.112692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 439/860] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:11.118413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:11.237023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13865e6-5e2d-44e2-a529-7b020ee8eb5e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:11.239317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:11.271913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:11.272765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:11.273050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:11.273330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:11.285264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:11.286780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:11.306986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:11.307909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:11.308843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:11.308843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:11.308843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:11.308843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:11.308843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 422/861] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:11.314149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:11.386738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:11.421611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca408-b186-40a6-97fc-dfcb8a8191c3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:11.458238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:11.458935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:11.459218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:11.459495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:11.460275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:11.460591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:11.462040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:11.477751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 440/862] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:11.483161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:11.596652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604d505-bd92-41f3-b07e-8b240c450381 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:11.633357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:11.634202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:11.635283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:11.635599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:11.643140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:11.644637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:11.660607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:11.661662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:11.662592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:11.665564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 423/863] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:28:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:11.669131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:11.774973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8349-a8fb-4c1f-bc76-deab5204f5eb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:11.807834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:11.812990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:11.813726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:11.814013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:11.814290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:11.815131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:11.815440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:11.816905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:11.835851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 441/864] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 8 13:28:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:11.841365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:11.860438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:11.945842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6ba8c-3904-43e0-b31c-08a3bf8354e0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:11.980438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:11.981087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:11.981365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:11.981637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.052946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:12.054377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:12.072698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:12.164829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 424/865] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:12.170282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:12.286481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249f52-f4a8-4822-98a0-89908272b891 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:12.326640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:12.327459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.327741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.328015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.339312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:12.340806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:12.359721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:12.360665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:12.361763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:12.361763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:12.361763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:12.361763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:12.361763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 442/866] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:12.368001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:12.470848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687a4e-ca13-4606-b05a-fad164c2f63d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:12.488240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:12.508075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:12.516253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.516253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.516253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.516253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:12.516253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:12.516253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d0dcc-b3c4-4d9d-9ec5-eb6dd53fdd94 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:12.523956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 425/867] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:12.530271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:12.575858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:12.622559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207225c3-62de-4d4d-a018-2a9742284383 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.622966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207225c3-62de-4d4d-a018-2a9742284383 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.623244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207225c3-62de-4d4d-a018-2a9742284383 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.624913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 426/868] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:12.629936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.630910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.631653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.640435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12890a-f63b-45f8-aa2d-9d0d4ca7d840 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:12.654829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:12.656631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:12.682759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:12.683803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.684259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.684673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.692351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:12.694053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:12.709382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:12.710307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:12.711185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:12.714427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 443/869] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:12.719874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:12.748010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 427/870] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:12.771393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:12.832994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875008b6-68eb-4ace-a1f4-f1d57b38a09d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:12.835102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:12.870812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:12.872024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.872574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.873095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.874197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:12.874712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:12.876409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:12.887631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3812-612b-4d6e-80a2-4e8786c83eb0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:12.891085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 444/871] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:12.898962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:12.899123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:12.927072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:12.928035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:12.928341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:12.928616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:12.929373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:12.931781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:12.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:12.946600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:12.948248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:12.949186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 428/872] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:12.955736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:13.017093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad412e-ebc4-444e-b26a-e1db7b450d6e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:13.069851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:13.070525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.070810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.071087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.073028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=19ce6d63072e4822aa4e4da5371d7090) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:13.073357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:13.074823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:13.083156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 445/873] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/role_assignments?user.id=19ce6d63072e4822aa4e4da5371d7090&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:13.094008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05413e8-f739-45fe-a896-5684f8ae19b7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:13.138872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:13.139568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.139856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.140163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.140904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:13.141216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:13.142668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2966e-7467-4817-ae3f-280a1db734e3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:13.148737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 429/874] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:13.157311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:13.191287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:13.274534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8f3b2-898a-4586-ba08-4effde8abb68 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:13.315653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:13.316365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.316646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.316918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.317635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:13.317936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:13.319319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea23b-4d5a-4f59-8c76-34556e6c80d9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:13.325738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 446/875] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:13.387655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda040a-9c54-44a9-9f9e-6335dc0c62d2 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.387994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda040a-9c54-44a9-9f9e-6335dc0c62d2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.388264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda040a-9c54-44a9-9f9e-6335dc0c62d2 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.389869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 430/876] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:13.395940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7f57-8312-4e44-9021-54924ac41cf9 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.396622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7f57-8312-4e44-9021-54924ac41cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.397127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f7f57-8312-4e44-9021-54924ac41cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.418767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ac6f7f57-8312-4e44-9021-54924ac41cf9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:13.419538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ac6f7f57-8312-4e44-9021-54924ac41cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:13.509678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 447/877] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:13.519025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14267c-7c40-4f62-8ed1-9216def18a73 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.519359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14267c-7c40-4f62-8ed1-9216def18a73 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.519591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14267c-7c40-4f62-8ed1-9216def18a73 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.521068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 431/878] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:13.527501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.527766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.528000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.535016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14267c-7c40-4f62-8ed1-9216def18a73 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:13.546967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:13.548199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:13.564770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:13.620599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:13.622647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 448/879] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:13.646344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:13.675123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14267c-7c40-4f62-8ed1-9216def18a73 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:13.718515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e73c3-5402-4743-bfc2-dcfe0f28d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:13.719211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e73c3-5402-4743-bfc2-dcfe0f28d052 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.719503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e73c3-5402-4743-bfc2-dcfe0f28d052 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.720077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e73c3-5402-4743-bfc2-dcfe0f28d052 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.720836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e73c3-5402-4743-bfc2-dcfe0f28d052 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:13.723180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e73c3-5402-4743-bfc2-dcfe0f28d052 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:13.756032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dcaef-3438-47b2-a935-eb6cafdf3d5f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:13.793882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 432/880] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:28:13 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:13.812193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbec6cb-3fb4-49fb-ae89-1414eeca61e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:13.813349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbec6cb-3fb4-49fb-ae89-1414eeca61e3 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:13.813843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbec6cb-3fb4-49fb-ae89-1414eeca61e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:13.814395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbec6cb-3fb4-49fb-ae89-1414eeca61e3 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:13.815505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbec6cb-3fb4-49fb-ae89-1414eeca61e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:13.817251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbec6cb-3fb4-49fb-ae89-1414eeca61e3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:13.910893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 449/881] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:28:13 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:15.559594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb640a-5116-420b-aaa1-641f5d279912 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:15.560162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb640a-5116-420b-aaa1-641f5d279912 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:15.560162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb640a-5116-420b-aaa1-641f5d279912 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:15.561753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 433/882] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:15.567117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:15.567517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:15.567703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:15.580502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:15.586467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:15.587937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:15.648865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcdc44-7ecd-4e8c-87d1-6af32eff3e11 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:15.649150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcdc44-7ecd-4e8c-87d1-6af32eff3e11 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:15.649538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcdc44-7ecd-4e8c-87d1-6af32eff3e11 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:15.652959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 434/883] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:15.657296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:15.657588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:15.657876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:15.665939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 450/884] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:15.675539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:15.676788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:15.690369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:15.770363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 435/885] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:15.793656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:15.799012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcc658-94ee-4d94-a541-37ccb62fc8fb None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:15.826039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:15.837615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:15.844571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:15.846932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:15.846932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:15.846932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:15.858778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:15.869173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:15.880881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 451/886] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 8 13:28:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:15.881865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:15.927532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdb808-936d-4506-8a33-fc6d131fe7b4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:15.976197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061d593-a330-4752-b27b-f63e87283a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:15.976924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061d593-a330-4752-b27b-f63e87283a7f None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:15.977349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061d593-a330-4752-b27b-f63e87283a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:15.978329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061d593-a330-4752-b27b-f63e87283a7f None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:15.979063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061d593-a330-4752-b27b-f63e87283a7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:15.980914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061d593-a330-4752-b27b-f63e87283a7f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:15.996764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444888e-0b5c-4813-a37c-42b1c4486818 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.032037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.034609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.034609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.034609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.034609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:16.034609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.035927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.045143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 452/887] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:28:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:16.050300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.059183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 436/888] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:28:15 2022] POST /identity/v3/services => generated 241 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:16.141326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.183432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6eca9-377a-47ca-95ae-40af8cfa298d None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.183782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6eca9-377a-47ca-95ae-40af8cfa298d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.183974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6eca9-377a-47ca-95ae-40af8cfa298d None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.185672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 437/889] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:16.193756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30e00e-ebe8-49bb-8316-b8fd5cdbd8b2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.194392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30e00e-ebe8-49bb-8316-b8fd5cdbd8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.194882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30e00e-ebe8-49bb-8316-b8fd5cdbd8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.200876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f74f5-6a79-4dce-b5c8-5d87b82abc74 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.215630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5b30e00e-ebe8-49bb-8316-b8fd5cdbd8b2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:16.217412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5b30e00e-ebe8-49bb-8316-b8fd5cdbd8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:16.253283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.254785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.255580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.256173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.269532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.275133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-2a8f24ee-b4e3-4dff-a603-3e5c20dfffe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:16.291984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:16.293130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:16.294069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:16.294069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:16.294069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:16.294069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:16.295674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 453/890] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:16.297119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d873-5f9e-4663-9483-840879da9912 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.297564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d873-5f9e-4663-9483-840879da9912 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.297842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d873-5f9e-4663-9483-840879da9912 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.299603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 454/891] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:16.301646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d873-5f9e-4663-9483-840879da9912 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.307055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 438/892] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:16.308403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.308686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.308962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.329245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:16.330491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:16.340886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.408182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 439/893] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:16.408182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.418556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d873-5f9e-4663-9483-840879da9912 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.422409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.457727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.458398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.458801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.459087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.459858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:16.460193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.461572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.476135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 455/894] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:16.481018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.520633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fef32c-f46c-4501-bed8-042fdae4df53 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.557067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.557868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.558150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.558422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.559071 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.560481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:16.572945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:16.574127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:16.574963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 440/895] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:16.575763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.590236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.592799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ed4a-d032-404f-816b-711c5ccd30f8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.628909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.629724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.630005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.630277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.630924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.632333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:16.645722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:16.647378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:16.648269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 456/896] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:16.649115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.678779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.694323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c36e-1091-4996-b4c6-3f4249e91124 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.731842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.732693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.732974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.733246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.742460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.743941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:16.759329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:16.760305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:16.765989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:16.766526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b011640-42ed-4068-9227-70c270749e78 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.766601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 441/897] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:16.766601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.801068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.801735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.802014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.802290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.802982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:16.803283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.804687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.814339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 457/898] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:16.815196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.835612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.873044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08fdb-b86c-48ca-bed9-a4d6e0cb4b48 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.907935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.908630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.908930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.909476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.910305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:16.910545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.911906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.921748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 442/899] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:16.921748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:16.922877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:16.935168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810313-c29e-4869-81b8-05019de4d822 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:16.972921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:16.973623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:16.973907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:16.974183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:16.975011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:16.975321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:16.976786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:16.995362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 458/900] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:16.996489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.032388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4c51-547b-4069-b714-696ad590551a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.064785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:17.070456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.071750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.072083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.072362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.073072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:17.073373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.074744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.079564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 443/901] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:17.080377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.114681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e700a-b7d3-4853-9e53-357b66edf82c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.153180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.154157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.154647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.155117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.156170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:17.156760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.158277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.163789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 459/902] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:17.164938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.181908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:17.192792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e3595-f8f8-4e03-a332-be956b340abc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.227420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.228078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.228427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.228709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.277929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84163c-9444-40d7-a03f-c7c354010ba6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.298814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:17.306787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.308335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.318077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.318742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.319016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.319287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.320106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] RBAC: Adding query filter params (interface=public, service_id=f8d564d7f54e4076adcf19faf14a64f2, region_id=RegionOne) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:17.320406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.322304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.332138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 460/903] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/endpoints?service_id=f8d564d7f54e4076adcf19faf14a64f2&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:17.332138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.416092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:17.422933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 444/904] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:17.427919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.442935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640dd85-64f7-4f3a-9be0-5087926f9ac7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.483953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.484741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.485019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.485290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.486056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] RBAC: Adding query filter params (interface=public, service_id=e2cf55bd86844faeb9f6751366b1f3c7, region_id=RegionOne) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:17.486362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.487716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.497161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 461/905] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/endpoints?service_id=e2cf55bd86844faeb9f6751366b1f3c7&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:17.497161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.532449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:17.539102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95ac7-704c-49db-a562-10ced6f9198b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.578889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.579536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.579833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.580142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.580826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.582213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.588579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 445/906] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:28:17.597244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.600234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4755f-b89e-4443-9a82-a76cef45a082 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.643753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.644937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.645403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.645883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.657096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:17.660590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.662459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:17.683458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:17.684495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:17.685420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:17.685420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:17.685420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:17.685420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:17.687815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 462/907] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:17.693874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.730865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fdb1b-fc4b-4d9f-ab2d-29f4bd836704 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.770188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.771223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.771700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.772200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.773175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.774838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.788530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 446/908] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:28:17.820741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e13b-6154-457f-8cbd-eeeed613248d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:17.862230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:17.862909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:17.863185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:17.863456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:17.864217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:17.864523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:17.866011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:17.880468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 463/909] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:17.885899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:17.922135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:18.007649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1a84a-b0c9-4094-a162-8d79b27c1ecd None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:18.044291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:18.045507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.046095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.046600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.053794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:18.055514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:18.070041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:18.071543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:18.072495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:18.075088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 447/910] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:18.080764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:18.142603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:18.194276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea4ed-0ba2-433e-b5fd-8b526673028e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:18.231482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:18.232179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.232469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.232749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.233533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:18.233844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:18.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19cf85-d40f-486f-bdfe-13d06b0f8a51 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:18.249297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 464/911] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:18.255220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:18.362567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf092-db67-4db3-a57b-8c8edc0ee41b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:18.370484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:18.398898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:18.400497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.400787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.401072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.401918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] RBAC: Adding query filter params (role.id=c6a4d8714dca48f1ae4366549a8bd9f7, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=19ce6d63072e4822aa4e4da5371d7090) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:18.402234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:18.403732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d575a68-d782-4c0e-897d-4afb5e5775d7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:18.410233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 448/912] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:18 2022] GET /identity/v3/role_assignments?user.id=19ce6d63072e4822aa4e4da5371d7090&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=c6a4d8714dca48f1ae4366549a8bd9f7 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:18.432616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49ac0-acf3-4735-99f7-bdc1b9c2e9ea None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.432911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49ac0-acf3-4735-99f7-bdc1b9c2e9ea None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.433181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49ac0-acf3-4735-99f7-bdc1b9c2e9ea None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.434681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 465/913] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:18.440547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.441124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.441589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.460331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:18.462392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:18.536932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 449/914] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:18.561627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49ac0-acf3-4735-99f7-bdc1b9c2e9ea None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:18.684132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49ac0-acf3-4735-99f7-bdc1b9c2e9ea None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:18.698458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:18.720274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:18.726091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.726091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.726091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.726091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:18.726091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:18.736998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:18.737995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:18.738824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 466/915] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:18.748016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:18.840434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:18.856634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104d764-24af-439c-9e17-6b9832fe36f6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:18.893399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:18.894073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:18.894359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:18.894635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:18.895346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:18.895653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:18.897150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:18.903678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 450/916] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:18.913147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:19.026109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c7c4b-ed85-49bf-b774-d79d73539c52 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:19.061825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:19.062505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:19.062790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:19.063065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:19.063776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:19.064103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:19.065486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:19.071539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 467/917] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:19.077226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:19.183467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b778-c822-4918-9fa9-479c0203a9f9 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:19.219338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:19.220004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:19.220315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:19.220597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:19.221386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] RBAC: Adding query filter params (interface=public, service_id=c4b2d040ace646e3b4774f4460df0188, region_id=RegionOne) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:19.221700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:19.223062 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2db9-b455-41d7-95d6-cb738590c787 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:19.228787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 451/918] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:19 2022] GET /identity/v3/endpoints?service_id=c4b2d040ace646e3b4774f4460df0188&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:19.234334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:19.279810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:19.342989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9d384-e4d0-4cfd-b2d9-b53d7c101b73 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:19.379492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713e775-29fa-437c-85c4-4e32b1529fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:19.380689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e775-29fa-437c-85c4-4e32b1529fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:19.381190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e775-29fa-437c-85c4-4e32b1529fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:19.381669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e775-29fa-437c-85c4-4e32b1529fc3 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:19.382551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713e775-29fa-437c-85c4-4e32b1529fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:19.384520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713e775-29fa-437c-85c4-4e32b1529fc3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:19.391617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 468/919] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:19 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:28:19.947308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655147-5947-4111-acf8-67722171f7f9 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:19.947810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655147-5947-4111-acf8-67722171f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:19.947810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655147-5947-4111-acf8-67722171f7f9 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:19.949429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 452/920] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:19.954432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940a42-ee36-4250-ac55-d8834d2ec1a9 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:19.954837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940a42-ee36-4250-ac55-d8834d2ec1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:19.954982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940a42-ee36-4250-ac55-d8834d2ec1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:19.972831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d0940a42-ee36-4250-ac55-d8834d2ec1a9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:19.974007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d0940a42-ee36-4250-ac55-d8834d2ec1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:20.048163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 469/921] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:20.066252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655147-5947-4111-acf8-67722171f7f9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.075907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:20.164919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327840-a14a-4d03-a4a6-133659483420 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.165324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327840-a14a-4d03-a4a6-133659483420 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.165482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327840-a14a-4d03-a4a6-133659483420 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.167170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 470/922] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:20.173032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.173811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.174189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.187566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655147-5947-4111-acf8-67722171f7f9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.194937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:20.197278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:20.225940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.226705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.227702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.227986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.228792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.230236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.232082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:20.244442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:20.247103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 13:28:20.248134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:20.249772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 453/923] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:20.256953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.285331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 471/924] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:20.309243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.347017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:20.385096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb87fd-f84b-4c99-a1cf-81a046d49669 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.424902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1f251-b4b7-4f29-976c-b9a06e05d42e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.430678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.431590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.432123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.432671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.433566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:20.434088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.435726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.446605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 454/925] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:20.448303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.462943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.463771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.464079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.464452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.465015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.466398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:20.483057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:20.484025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 13:28:20.484925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:20.488218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 472/926] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 8 13:28:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:20.491421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.530172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:20.576487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb2a8-1e20-433e-9a2d-02fddfc77cbc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.615586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.616662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.617242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.618254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.619206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:20.619736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.621335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992dc19-13a0-475a-916e-490522c4dd34 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.621640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.623259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:20.633235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 455/927] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 8 13:28:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:20.634860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.661989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.662681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.662950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.663224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.663929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:20.664794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.666759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.678677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 473/928] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:20.679593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.754117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac40a8-93ee-4c76-9598-70329c567f94 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.779135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:20.788447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719c99-c9c9-49ea-9c38-3783f97bce3b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.792907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf00960-c269-48cd-b44f-512cdff9ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.798825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00960-c269-48cd-b44f-512cdff9ace3 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.798825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00960-c269-48cd-b44f-512cdff9ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.798825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00960-c269-48cd-b44f-512cdff9ace3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.798825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf00960-c269-48cd-b44f-512cdff9ace3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.798825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf00960-c269-48cd-b44f-512cdff9ace3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.824840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:20.825511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.825878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.826155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.826863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:20.827168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:20.828570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0f2c1-ca0a-4b21-8c28-bb53a2e5c628 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:20.834157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 474/929] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:20.835406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace0c7-5432-4b84-8b8e-05a0980e149f None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.835690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace0c7-5432-4b84-8b8e-05a0980e149f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.835960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace0c7-5432-4b84-8b8e-05a0980e149f None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.837866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 475/930] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:20.839931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace0c7-5432-4b84-8b8e-05a0980e149f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:20.888089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 456/931] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:20.888089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:20.888089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:20.888089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:20.913145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:20.915380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:20.977406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace0c7-5432-4b84-8b8e-05a0980e149f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:20.983931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:21.011092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 457/932] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:21.028846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:21.028846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.029545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.031162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.032131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:21.033795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:21.035413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:21.155742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 476/933] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:21.170170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f621-6fee-4e12-8c79-735de1bcafbe None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:21.219580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:21.220811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.221100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.221438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.234324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:21.244026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:21.245069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:21.246135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 458/934] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 8 13:28:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:21.252293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:21.272175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:21.382356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91b4ba-318e-47e2-bf19-3c2ba7703e9b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:21.420769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:21.421446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.421722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.421991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.422734 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:21.423036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:21.424433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:21.433946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 477/935] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:28:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:21.439278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:21.483621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:21.546370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049978f0-1fa8-44e6-bee7-b3e0d65e4596 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:21.584493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:21.585295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.585578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.585862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.598156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:21.599616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-d56da016-b4f7-4bea-a2e3-0f05e9a52a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:21.618813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:21.619823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:21.620773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:21.620773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:21.620773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:21.620773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:21.620773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 459/936] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:21.627067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:21.703528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:21.721944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb8b5-0845-4d3d-be7f-d8ce49fd6d45 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.722253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb8b5-0845-4d3d-be7f-d8ce49fd6d45 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.722509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eb8b5-0845-4d3d-be7f-d8ce49fd6d45 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.724285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 460/937] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:21.730011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.730385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.730670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.739804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e121-9fc0-435e-933c-17620e8e91dc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:21.753700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:21.755202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:21.779459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:21.780513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.780999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.781499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.782419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:21.782940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:21.784794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:21.799135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 478/938] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:21.804789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:21.852851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 461/939] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:21.877481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:21.912503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:21.922250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603560-e50e-4985-939f-07c78bd9e6f5 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:21.958986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:21.968478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:21.971539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:21.971539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:21.971539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:21.981668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:21.983822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:22.003563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:22.004578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:22.005540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:22.013070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 479/940] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:28:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:22.014159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.014288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22f3b3-cda5-4514-bb53-04f2649b371e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.059105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.060551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.061058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.061533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.062374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.063926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:22.077194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:22.078263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:22.079114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:22.087625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 462/941] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:22.096141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.147792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80728-b522-4f6d-94c5-14848083b77d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.187694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.188433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.188791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.189069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.189902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:22.190213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.191747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.209546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:22.212353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 480/942] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:22.220100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.224634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c78ea-654c-48b2-a4a5-1c0ed1963fc9 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.274226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.275891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.276495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.276954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.277817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:22.278508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:22.279645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.281349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.288952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 463/943] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:22.295508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.341208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe5cf-d4c2-4a18-87d9-8a18866f578f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.382217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.383081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.383356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.383632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.394365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.395966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:22.416379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:22.417340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:22.418249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:22.418249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:22.418249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:22.418249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:22.422580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 481/944] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:22.423659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.426135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58007-e4f7-4686-8635-d6824d9eab6d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.465868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.466594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.466884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.467217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.467982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:22.468339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.470417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.475512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 464/945] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:22.481606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.512603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:22.551051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:22.555320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5260c-d13f-4239-a5eb-d5c72932301f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.604438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.605468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.605790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1335-1080-4b0e-9c67-058ea1453134 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.606169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.606723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.608872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:22.609411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.610999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.627622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 482/946] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:22.632268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.654551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.655585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.656619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.657127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.658390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.660930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.738786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b918-cd07-45a6-96bf-a435216fae67 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:22.750656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 465/947] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:22.791433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:22.792285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:22.792569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:22.792839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:22.801094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:22.802639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:22.819245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:22.820349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:22.821571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 483/948] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:22.827187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:22.919583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:22.960046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437ae7a-fe46-4693-bfc6-1657d9145452 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:23.000445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:23.001131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.001417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.001699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.002507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:23.002820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:23.004294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325b91-e13e-4eb8-b119-432ac80c17c5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:23.019055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 466/949] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:23.026258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:23.045443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:23.138680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605012f7-89ae-4a00-9df5-c052c6ae4170 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:23.175659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237d15-b78c-41c1-ae33-4b991c9d522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:23.176513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237d15-b78c-41c1-ae33-4b991c9d522d None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.176796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237d15-b78c-41c1-ae33-4b991c9d522d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.177076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237d15-b78c-41c1-ae33-4b991c9d522d None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/19ce6d63072e4822aa4e4da5371d7090/roles/c6a4d8714dca48f1ae4366549a8bd9f7` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.179416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36237d15-b78c-41c1-ae33-4b991c9d522d None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=19ce6d63072e4822aa4e4da5371d7090, role_id=c6a4d8714dca48f1ae4366549a8bd9f7)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:23.181547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36237d15-b78c-41c1-ae33-4b991c9d522d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:23.261031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 484/950] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:23 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/19ce6d63072e4822aa4e4da5371d7090/roles/c6a4d8714dca48f1ae4366549a8bd9f7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:28:23.328487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df18c8-cc63-4aff-90d1-773e9214433f None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.328844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df18c8-cc63-4aff-90d1-773e9214433f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.329130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df18c8-cc63-4aff-90d1-773e9214433f None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.331036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 467/951] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:23.338392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340b41-92fd-4cc5-9070-138c934d728a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.339077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340b41-92fd-4cc5-9070-138c934d728a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.339550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340b41-92fd-4cc5-9070-138c934d728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.359084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-aa340b41-92fd-4cc5-9070-138c934d728a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:23.360739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-aa340b41-92fd-4cc5-9070-138c934d728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:23.444247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 485/952] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:23.468540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df18c8-cc63-4aff-90d1-773e9214433f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:23.588892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df18c8-cc63-4aff-90d1-773e9214433f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:23.621480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:23.627177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:23.627860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.628377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.628655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.629472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:23.630914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:23.632370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING keystone.server.flask.common [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 13:28:23.665645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794e983-23c8-4484-b6df-28b70562cc19 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.665997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794e983-23c8-4484-b6df-28b70562cc19 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.666213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794e983-23c8-4484-b6df-28b70562cc19 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.667869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 486/953] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:23.672939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.673226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.673605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.680638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.sql.core [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 13:28:23.680638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 13:28:23.680638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [parameters: {'id': '4cdef04af0cc42cd8056e06b1204699b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 13:28:23.680638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 13:28:23.686912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4cdef04af0cc42cd8056e06b1204699b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4cdef04af0cc42cd8056e06b1204699b. Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application conn.query(q) Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 13:28:23.688155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result.read() Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 08 13:28:23.689001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application next(self.gen) Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application yield resource Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application next(self.gen) Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise self.value Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application session.commit() Jun 08 13:28:23.689976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.session.flush() Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application compat.raise_( Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 13:28:23.690889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 13:28:23.691962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application conn.query(q) Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application result.read() Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 13:28:23.694414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [parameters: {'id': '4cdef04af0cc42cd8056e06b1204699b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:23.696273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:23.704376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4cdef04af0cc42cd8056e06b1204699b. Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 468/954] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jun 8 13:28:23 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:23.705659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:23.706962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:23.708314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:23.781074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 487/955] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:23.803813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:23.814785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba43a6-907f-45a6-bf98-630af31ad5eb None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:23.852963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:23.854131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.854421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.854697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.862554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:23.864246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:23.880652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:23.881781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:23.882901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 469/956] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:23.888088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:23.929584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61edbc-fb95-41e1-9d86-c6ce827c92c9 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:23.947761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:23.980179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:23.981359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:23.981924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:23.982398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:23.983738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:23.985826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:23.990269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:24.004156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:24.005360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:24.006233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:24.013669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 488/957] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:24.015265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:24.022114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda706e-b109-4898-a86a-dab85f781850 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:24.066895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:24.067944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:24.068273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:24.068553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:24.069311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:24.069673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:24.072309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:24.099286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 470/958] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:24.149113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646acbc4-26a6-4de0-b70e-9692a903ca5f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:24.191768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:24.192880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:24.193367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:24.193842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:24.194798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:24.195554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:24.197390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b3db6-ccc2-4f33-897d-8297587ca36b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:24.203860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 489/959] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:24.209986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:24.323941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781effa8-84e7-45cd-8242-322d2e1638b6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:24.331424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:24.358727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:24.359435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:24.359716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:24.360036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:24.360895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:24.361202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:24.362784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2031d-6f81-46d0-afdf-dd5628af7de1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:24.368497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 471/960] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:25.163388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a5fa-f6f5-4c8f-a483-b376de63497f None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.164570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a5fa-f6f5-4c8f-a483-b376de63497f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.164671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a5fa-f6f5-4c8f-a483-b376de63497f None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.166233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 490/961] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:25.171719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.172206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.172295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.190138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:25.191623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:25.265348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 472/962] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:25.289573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a5fa-f6f5-4c8f-a483-b376de63497f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:25.361390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:25.403469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a5fa-f6f5-4c8f-a483-b376de63497f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:25.442967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:25.443787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.444091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.444373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.445701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:25.447097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:25.459463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:25.460551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:25.461949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 491/963] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:25.466803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:25.567652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:25.571085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f36d7-cc0f-48db-a61f-e68f6d534dcd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:25.608383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:25.609055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.609336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.609607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.610313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:25.610617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:25.612032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68223d35-00ec-454e-9ee3-0c7ea97a53f0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:25.617294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 473/964] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:25.622879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:25.664854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d47d8-7a43-4489-b5b6-d9e684bc6765 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.665207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d47d8-7a43-4489-b5b6-d9e684bc6765 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.665420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d47d8-7a43-4489-b5b6-d9e684bc6765 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.667065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 474/965] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:25.672424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.672713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.672995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.690418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:25.691607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:25.751282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0f3c-6175-416a-a15b-918ba52f4684 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:25.768429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 475/966] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:25.782073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:25.789444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:25.799008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:25.799682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.800012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.800315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.801054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:25.801810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:25.803607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:25.811107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 492/967] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:25.816676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:25.896373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:25.904633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112da027-d561-4e6f-be71-b50087ea0429 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:25.941949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:25.942768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:25.943052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:25.943325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:25.952989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec6b0-315a-4c15-9f89-6f8b04dfea9f None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:25.955269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:25.963842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:25.964824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:25.965738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 476/968] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 8 13:28:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:25.971712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.003959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.005510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.006062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.006769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.008600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] RBAC: Adding query filter params (interface=admin, service_id=c4b2d040ace646e3b4774f4460df0188, region_id=RegionOne) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:26.009352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.011625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.023724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 493/969] 10.222.0.55 () {56 vars in 1249 bytes} [Wed Jun 8 13:28:25 2022] GET /identity/v3/endpoints?service_id=c4b2d040ace646e3b4774f4460df0188&interface=admin®ion_id=RegionOne => generated 193 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:26.025548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.094808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:26.116340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec234f4-2c3b-4a93-bd82-31f9ec794792 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.154533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8a1b-433e-472e-8f16-bc9b32f8c3d8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.157986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.158854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.159239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.159616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.160507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:26.160922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.162408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.178067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 477/970] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:28:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:26.180733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.201954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.212021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.212021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.212021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.212021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.212343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:26.212419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.213543 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 494/971] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:26 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:28:26.305770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa722d5-e3e9-4b01-bcd2-c965c82bc822 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.345291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.346418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.346876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.347355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.359001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.360786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:26.380512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:26.381493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:26.382980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:26.382980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:26.382980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:26.382980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:26.385113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 478/972] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:26.391354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.505399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858390b9-4aa2-4693-8481-de0b185f9a2c None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.527769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:26.541986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.542652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.552351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.552351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.552351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:26.552351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.552351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2196330-7b16-4ef4-8415-f5fe53d82430 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.558878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 495/973] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:26.564326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.594457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63d89f-e224-4fa4-aa21-b1c504460cb1 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.594787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63d89f-e224-4fa4-aa21-b1c504460cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.594997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63d89f-e224-4fa4-aa21-b1c504460cb1 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.597673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 496/974] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:26.601878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.602163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.602439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.620413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:26.622082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:26.636439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:26.675908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5afe6-bf8e-48a7-bc20-fb42cce3ca4c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.711945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 497/975] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:26.721739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.722564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.722837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.723105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.731843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.733453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.736929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0f2b4ded-6f89-417f-84eb-fd8c5f791cd0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:26.749972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:26.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:26.751940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 479/976] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:28:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:26.753095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5759dbd-fc79-49b5-86da-b532f877b260 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.753095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5759dbd-fc79-49b5-86da-b532f877b260 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.753342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5759dbd-fc79-49b5-86da-b532f877b260 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.754679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 480/977] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:26.757408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5759dbd-fc79-49b5-86da-b532f877b260 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:26.849493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e781f-75b8-430a-a846-513ff4dc6b7e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.861773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:26.863463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5759dbd-fc79-49b5-86da-b532f877b260 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:26.889462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.890417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.890818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:26.890958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.891292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.892164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.893517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.894819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING keystone.server.flask.common [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 13:28:26.899446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:26.900147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.900431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.900707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.901700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:26.902014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:26.903763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dffa7-c2ec-4cca-91a1-c6b8a11b4889 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:26.922029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 481/978] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 8 13:28:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:26.923268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:26.923560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:26.923838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:26.931119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.sql.core [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 13:28:26.931119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 13:28:26.931119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [parameters: {'user_id': '9a4743fdf0e24adf944ab519d7cfa5ff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 13:28:26.931119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80578) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 13:28:26.940080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:26.941244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application conn.query(q) Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application result.read() Jun 08 13:28:26.947306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 13:28:26.948602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application next(self.gen) Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application yield resource Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application next(self.gen) Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise self.value Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application session.commit() Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 13:28:26.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self.session.flush() Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application compat.raise_( Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 13:28:26.950762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 13:28:26.951676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application conn.query(q) Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application result.read() Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 13:28:26.954451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [parameters: {'user_id': '9a4743fdf0e24adf944ab519d7cfa5ff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:26.956818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 08 13:28:26.957906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 498/979] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 8 13:28:26 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:26.959075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.022475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 482/980] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:27.023757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.082940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff507cc-a2e6-4415-b1aa-195da3b37828 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:27.124913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:27.125561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:27.125846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:27.126120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:27.135911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42826b-6b3d-4d70-9939-a919f7bb3e54 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:27.154121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:27.169736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:27.173928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:27.174855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:27.175063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:27.175261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:27.184497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:27.187210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:27.196989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:27.198710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:27.202412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:27.203539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 13:28:27.204898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:27.212264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 483/981] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:27.212264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.313258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4d46-5e3e-4b2e-a779-c35ec5778c21 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:27.325626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 499/982] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:26 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:27.325626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.357411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:27.358164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:27.358444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:27.358717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:27.359414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:27.360803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:27.399482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:27.428019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d563c3-2238-4c87-9ed3-774a976769a9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:27.456104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 484/983] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:28:27 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:27.456104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.485700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:27.486958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:27.487394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:27.488023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:27.489484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:27.490124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:27.493610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:27.532435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:27.540590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 500/984] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 8 13:28:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:27.588039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58a3a5-be93-4294-a1f5-11dc14b0603e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:27.630135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:27.631018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:27.631310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:27.637981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:27.645730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:27.647245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:27.670039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:27.671187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:27.672111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:27.672111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:27.672111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:27.672111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:27.672111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 485/985] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:27.680552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.793295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1ab51-fd96-4449-bd87-c198739fc538 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:27.822779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:27.831459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:27.832222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:27.832509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:27.832786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:27.833520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:27.841722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:27.841722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:27.848750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 501/986] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:27.854938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:27.956021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:27.969848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418438b-7b67-40f7-b51b-966ec975e5f7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:28.004996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:28.005945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:28.006330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:28.006704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:28.014511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:28.016135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:28.030829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:28.031965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:28.033137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:28.039694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 486/987] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:28.041474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:28.152420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c32b5-6d94-4631-96f5-b0ace993bd8b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:28.187298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:28.188126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:28.188310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:28.188546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:28.189318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:28.189622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:28.191043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffce3e-994d-40bf-873f-f1a9d71f3b65 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:28.203597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 502/988] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:28.209312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:28.313115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94e94-168e-43b0-8649-f78f274c0de7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:28.351696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:28.352401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:28.352745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:28.353082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:28.353971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] RBAC: Adding query filter params (role.id=c6a4d8714dca48f1ae4366549a8bd9f7, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=19ce6d63072e4822aa4e4da5371d7090) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:28.354345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:28.355814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654be1e-9544-408c-8eec-0261ae93244e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:28.368103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 487/989] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:28 2022] GET /identity/v3/role_assignments?user.id=19ce6d63072e4822aa4e4da5371d7090&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=c6a4d8714dca48f1ae4366549a8bd9f7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:28.667762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcbd99-5c62-4db9-a769-0df05db6fb4a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:28.668289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcbd99-5c62-4db9-a769-0df05db6fb4a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:28.668289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcbd99-5c62-4db9-a769-0df05db6fb4a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:28.669670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 503/990] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:28.674886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:28.675181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:28.675463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:28.693705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:28.695522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:28.703905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:28.766363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 488/991] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:28.790839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcbd99-5c62-4db9-a769-0df05db6fb4a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:28.840005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:28.896405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcbd99-5c62-4db9-a769-0df05db6fb4a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:28.932321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:28.933039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:28.933314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:28.933579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:28.934218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:28.935567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:28.947313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:28.948421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:28.954230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 504/992] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 8 13:28:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:28.955044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:29.055196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f4f2-fd0c-4f5c-bc71-86453a515176 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:29.096365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:29.097039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:29.097318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:29.097590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:29.098296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:29.098598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:29.099956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:29.106012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 489/993] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:29.111536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:29.212871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06efa39-10cd-46db-a259-078bcfb0f87e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:29.223191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:29.246774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:29.247479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:29.247756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:29.248027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:29.248765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:29.249101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:29.250420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d0d1-7276-435b-a26c-393a4aa924ae None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:29.255517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 505/994] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 8 13:28:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:29.261349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:29.270422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:29.365016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39cc3-5336-4a38-9d55-5c627b34165b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:29.398809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958ce49-615f-4bb8-9f14-dfd44d40e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:29.399468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958ce49-615f-4bb8-9f14-dfd44d40e652 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:29.399746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958ce49-615f-4bb8-9f14-dfd44d40e652 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:29.400014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958ce49-615f-4bb8-9f14-dfd44d40e652 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:29.400770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958ce49-615f-4bb8-9f14-dfd44d40e652 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:29.402136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958ce49-615f-4bb8-9f14-dfd44d40e652 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:29.504189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 490/995] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:29.883793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e5e88-7bc8-4ee4-b48e-ff1f9c725d10 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:29.884358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e5e88-7bc8-4ee4-b48e-ff1f9c725d10 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:29.884358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e5e88-7bc8-4ee4-b48e-ff1f9c725d10 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:29.885795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 506/996] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:29.891126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:29.891424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:29.891710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:29.909473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:29.910672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:29.975180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:29.991987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 491/997] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:30.016570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e5e88-7bc8-4ee4-b48e-ff1f9c725d10 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:30.131255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e5e88-7bc8-4ee4-b48e-ff1f9c725d10 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:30.167567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:30.168321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.168603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.168875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.169523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:30.170889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:30.184169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:30.185215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:30.191333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 507/998] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:30.193814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:30.299689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f706c-3e5e-44d0-9cea-4e5d2963d700 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:30.343649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:30.344356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.344638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.344914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.345623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] RBAC: Adding query filter params (name=compute) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:30.345928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:30.347302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:30.356933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 492/999] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:30.358497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:30.402153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:30.465975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07c89-3555-402c-b7a8-dbcb0f253cb0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:30.503353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:30.504091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.504433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.504714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.505538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:30.505964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:30.508298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dde9a-d7a1-447b-b26d-dff2dcc9682e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:30.516207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 508/1000] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:30.520544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:30.581707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:30.627464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d249c0-fdb7-4da4-9a48-7fa71fdd5dad None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:30.634324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d192347-9bf4-46f1-b626-4102e0f7681e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.634632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d192347-9bf4-46f1-b626-4102e0f7681e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.634883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d192347-9bf4-46f1-b626-4102e0f7681e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.636514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 509/1001] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:30.642095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.642439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.642750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.660823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:30.662318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:30.669725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:30.670383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.670672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.670949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.671739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] RBAC: Adding query filter params (interface=public, service_id=42b06a9fc57b45e5bdacaa81b9cea979, region_id=RegionOne) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:30.672082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:30.673451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:30.685159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 493/1002] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/endpoints?service_id=42b06a9fc57b45e5bdacaa81b9cea979&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:30.686907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:30.738687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 510/1003] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:30.761490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:30.796263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea3c7b-3e48-40ee-9890-45aa40ae47eb None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:30.796508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:30.818006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:30.831877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:30.832573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.832857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.833133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.833813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:30.835253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:30.841465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 494/1004] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:28:30.875635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2538068-bfb2-4c08-8f84-0c3290d3e35f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:30.913898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:30.914819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:30.914991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:30.915264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:30.915915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:30.917366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:30.930525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:30.936269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:30.937194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 511/1005] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:30.940747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:31.055118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a486-9e22-4a16-aa40-9ae3786977ec None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:31.095850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:31.096580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:31.096863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:31.097144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:31.097852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] RBAC: Adding query filter params (name=image) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:31.098156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:31.099523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c30f3-2486-4839-b39c-b4ad7c2042ce None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:31.105814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 495/1006] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:31.111268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:31.212958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:31.219029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e80e95-99b4-4c60-8f92-96cc19e3e4e1 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:31.254080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:31.254767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:31.255110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:31.255406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:31.256101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:31.260620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:31.260620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff89a0-e065-4c43-88fd-d9110544e8d5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:31.268086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 512/1007] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:31.852325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827199-3905-47ee-9892-b2097770c0a1 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:31.852931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827199-3905-47ee-9892-b2097770c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:31.853340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827199-3905-47ee-9892-b2097770c0a1 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:31.855157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 496/1008] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:31.861073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:31.861361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:31.861638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:31.878822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:31.880003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:31.952750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 513/1009] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:31.979270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827199-3905-47ee-9892-b2097770c0a1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:32.033407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:32.095566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827199-3905-47ee-9892-b2097770c0a1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:32.134704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441378a-638d-49af-bc38-5ee1d62ebeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:32.135418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441378a-638d-49af-bc38-5ee1d62ebeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:32.135700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441378a-638d-49af-bc38-5ee1d62ebeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:32.135976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441378a-638d-49af-bc38-5ee1d62ebeb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:32.137189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441378a-638d-49af-bc38-5ee1d62ebeb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:32.138631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441378a-638d-49af-bc38-5ee1d62ebeb3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:32.140449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 497/1010] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:32.145971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:32.238975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:32.249298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d514ed1-ce53-40c6-aa60-a397b126858f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:32.283985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52d55-cf4d-4055-93cd-738486a351de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:32.284674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52d55-cf4d-4055-93cd-738486a351de None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:32.284958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52d55-cf4d-4055-93cd-738486a351de None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:32.285236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52d55-cf4d-4055-93cd-738486a351de None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:32.285953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52d55-cf4d-4055-93cd-738486a351de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:32.287381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52d55-cf4d-4055-93cd-738486a351de None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:32.385287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 514/1011] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:28:32 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:33.116944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f84dc5-4867-47bd-a8aa-e32d579ddc05 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.117460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f84dc5-4867-47bd-a8aa-e32d579ddc05 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.117556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f84dc5-4867-47bd-a8aa-e32d579ddc05 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.118993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 498/1012] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:33.124220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.124623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.124802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.141742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:33.142913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:33.215072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 515/1013] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:33.238677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f84dc5-4867-47bd-a8aa-e32d579ddc05 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:33.340445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f84dc5-4867-47bd-a8aa-e32d579ddc05 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:33.356945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:33.374992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:33.375785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.376082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.376362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.377001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:33.378338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0802aaff-72a7-4aa4-8a0e-5d88d1d38b42 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:33.390427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:33.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 13:28:33.392677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:33.396133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 499/1014] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:33.398456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:33.467569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:33.496872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d727-7865-43ed-a7d0-a63eac798676 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:33.531336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:33.532369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.533142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.533632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.534561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:33.535067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:33.536657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:33.543595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d235-0f64-497b-ae0a-b3966a9d5b63 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.543868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 516/1015] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:33.543989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d235-0f64-497b-ae0a-b3966a9d5b63 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.544180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1d235-0f64-497b-ae0a-b3966a9d5b63 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.545785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 500/1016] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:33.549034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:33.550567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.550858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.551138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.568130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:33.569313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:33.644692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 501/1017] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:33.661204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0ace5-dcba-4b5c-a67a-333d4446689d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:33.671708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:33.703464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:33.704160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.704444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.704892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.705407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:33.705727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:33.707071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:33.709735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:33.716389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 517/1018] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 8 13:28:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:33.718392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:33.779298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e38e8-fb39-4ba0-ba4f-fe2e66fb4c77 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:33.792679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:33.816774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a04a-eab5-472d-a91c-d91ed445a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:33.817435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a04a-eab5-472d-a91c-d91ed445a57e None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.817753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a04a-eab5-472d-a91c-d91ed445a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.817978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a04a-eab5-472d-a91c-d91ed445a57e None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.818689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545a04a-eab5-472d-a91c-d91ed445a57e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:33.820332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545a04a-eab5-472d-a91c-d91ed445a57e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:33.827556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573a40d-a9f5-4f86-a9da-b62a0f4e0899 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:33.862696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075e835-9db8-4122-b308-5c5582d1c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:33.863354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075e835-9db8-4122-b308-5c5582d1c7c6 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:33.863628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075e835-9db8-4122-b308-5c5582d1c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:33.863899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075e835-9db8-4122-b308-5c5582d1c7c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:33.864656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075e835-9db8-4122-b308-5c5582d1c7c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:33.866768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075e835-9db8-4122-b308-5c5582d1c7c6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:33.929030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 502/1019] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:28:33 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:33.950311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 518/1020] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:34.801493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134816-1767-49ab-84eb-d083ed8f5881 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:34.802030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134816-1767-49ab-84eb-d083ed8f5881 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:34.802339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134816-1767-49ab-84eb-d083ed8f5881 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:34.803866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 503/1021] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:34.809883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:34.810408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:34.810581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:34.829314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:34.830594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:34.884988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:34.907351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 519/1022] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:34.934198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134816-1767-49ab-84eb-d083ed8f5881 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:35.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134816-1767-49ab-84eb-d083ed8f5881 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:35.079067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404b83-1fa0-46ce-bdb1-1ac6d4ff5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:35.079884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404b83-1fa0-46ce-bdb1-1ac6d4ff5a61 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:35.080194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404b83-1fa0-46ce-bdb1-1ac6d4ff5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:35.080464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404b83-1fa0-46ce-bdb1-1ac6d4ff5a61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:35.081734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c404b83-1fa0-46ce-bdb1-1ac6d4ff5a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:35.083181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c404b83-1fa0-46ce-bdb1-1ac6d4ff5a61 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:35.085688 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 504/1023] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:35.092122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:35.193595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62967888-8a94-4963-8e44-d58e84858a7c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:35.232691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a83e0-641e-42b5-8b94-add60d1a6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:35.233364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a83e0-641e-42b5-8b94-add60d1a6fb5 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:35.233642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a83e0-641e-42b5-8b94-add60d1a6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:35.233909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a83e0-641e-42b5-8b94-add60d1a6fb5 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:35.234609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a83e0-641e-42b5-8b94-add60d1a6fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:35.236030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a83e0-641e-42b5-8b94-add60d1a6fb5 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:35.341183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 520/1024] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:28:35 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:36.217007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733d25d-7938-4199-8222-e76148cff3ca None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.217528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733d25d-7938-4199-8222-e76148cff3ca None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.217528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733d25d-7938-4199-8222-e76148cff3ca None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.218899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 505/1025] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:36.224429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f99d53-8873-4fbe-9449-7daabbe9c3e9 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.224961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f99d53-8873-4fbe-9449-7daabbe9c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.225041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f99d53-8873-4fbe-9449-7daabbe9c3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.242205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-b5f99d53-8873-4fbe-9449-7daabbe9c3e9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:36.243382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b5f99d53-8873-4fbe-9449-7daabbe9c3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:36.275652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:36.313431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 521/1026] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:36.337738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733d25d-7938-4199-8222-e76148cff3ca None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.378871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:36.422307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b188-c323-4840-b05b-64f14900a85e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.422853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b188-c323-4840-b05b-64f14900a85e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.423138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b188-c323-4840-b05b-64f14900a85e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.424537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 522/1027] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:36.430129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.430411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.430692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.443463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733d25d-7938-4199-8222-e76148cff3ca None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.448183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:36.449354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:36.477544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:36.478333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.478613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.478886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] PATH_INFO: `/v3/services/image` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.479531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:36.480917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:36.493096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:36.494114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:36.494977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:36.499368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 506/1028] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:36.499972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.517354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 523/1029] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:36.541299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.608460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189eb3-3a70-43c8-9dfd-fcaa80bb7207 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.610125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:36.641974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:36.646436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6e3ab-d630-44f8-b933-8dc72ca20916 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.647087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:36.647753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.648038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.648373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.649093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:36.649390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:36.650768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:36.660808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 507/1030] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:36.661964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.687009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:36.687831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.688147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.688423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.698911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:36.707122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:36.708310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:36.709736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 524/1031] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:36.715029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.777934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571469e-9d76-4751-a4d0-c389d4f12bd5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.815311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:36.815970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.816280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.816557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.817118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3217b7-7cac-4c70-9982-d22b7f93f600 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.817286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] RBAC: Adding query filter params (type=image) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:36.817561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:36.819870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:36.825177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 508/1032] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:36.831012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.852451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:36.853116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.853393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.853662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.854392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:36.854693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:36.856084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:36.862668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:36.868638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 525/1033] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:36.869673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:36.893274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:36.946173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6ae1-7126-40b0-a6a4-352c1f00af87 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.977650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be692b-66c3-40bf-9a5e-ae43efdd30e4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:36.982569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:36.983232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:36.983539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:36.983819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:36.984636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] RBAC: Adding query filter params (interface=public, service_id=aab268bd29a64297ace00a90bdd10642, region_id=RegionOne) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:36.984941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:36.986299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:36.996613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 509/1034] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/endpoints?service_id=aab268bd29a64297ace00a90bdd10642&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:36.997825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.013960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:37.014757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.015032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.015299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.026931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:37.028438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:37.045498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:37.046432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:37.047356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:37.047356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:37.047356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:37.047356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:37.047356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 526/1035] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:37.052335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.104809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:37.111296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4be57-b16f-4f7f-8d62-90d30860f346 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:37.133116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:37.150922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:37.151514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.151798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.152098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.153172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:37.154134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:37.162559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 510/1036] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:28:36 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:28:37.166959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab828e55-0121-4c35-8409-2c8439510f0b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:37.207564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:37.208279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.208561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.208833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.209809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:37.210082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:37.211486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:37.228047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 527/1037] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:37.234162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.346556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e70d5-6d29-4c34-bd1e-347afef1ecc5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:37.387308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:37.388167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.388449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.388723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.397634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:37.399105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:37.415756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:37.416906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:37.417987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:37.420210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 511/1038] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:28:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:37.423388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.531618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5ed6-4f53-49cb-8161-dd4c0095d8d0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:37.563239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:37.568970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:37.569653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.569937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.570215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.571046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:37.571356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:37.572855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e3d1e-5926-41df-8cea-a0bac62d590e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:37.591370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 528/1039] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:28:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:37.597029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.616879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:37.708088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d99c8-d081-40f3-8d45-e0ec5c94b9a0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:37.745321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:37.745987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.746274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.746553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.751490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eb434-d91b-4d43-844a-a4b574e888fa None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.751785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eb434-d91b-4d43-844a-a4b574e888fa None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.752137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eb434-d91b-4d43-844a-a4b574e888fa None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.753810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 529/1040] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:37.759187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:37.759471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:37.759794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:37.777435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:37.778671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:37.824811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:37.826628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:37.845155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:37.850824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 530/1041] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:37.875230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.935686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 512/1042] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:37.941336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:37.985383 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276d77-8d82-4bc0-9a61-0ef9db8b7d23 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.009036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.025118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.034237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.034237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.034237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.038639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:38.043488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a901-a25b-4a02-9c8b-25faed130a5c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:38.047117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:38.048073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:38.048948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 531/1043] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:38.056707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.065602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.082682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.083543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.084434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.084853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.098586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.100256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:38.118588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:38.119528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:38.120674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:38.120674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:38.120674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:38.120674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:38.120674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 513/1044] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:38.125437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.173112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705133c-23f8-4b5f-bfd7-7f150912dfb2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.211553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.212363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.212694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.213030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.213863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:38.214228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.215840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.226316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 532/1045] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:38.231806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.238549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a7543-7398-48d3-b2ae-f2897f78d8a7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.276171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.276837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.277118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.277395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.278110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:38.278419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.279789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.282731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.293529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 514/1046] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:38.299097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.331936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.352752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92fb73-3d29-4d22-b69c-f239ac17cd6a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.388269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.389569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.390049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.390504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] PATH_INFO: `/v3/users/5b0dc5e0e3ee48c58947a5e5f985ac3e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.406441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0dc5e0e3ee48c58947a5e5f985ac3e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.408555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.410885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 533/1047] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/users/5b0dc5e0e3ee48c58947a5e5f985ac3e => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:38.416642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.419189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961b4d-c1d5-4fc9-be4b-53ea3df202b6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.460395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.461314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.461603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.462107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.469493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.470948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:38.485380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:38.486442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:38.487379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 515/1048] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:38.493130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.522610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.525750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087895-d4b7-4b08-be38-f138276be354 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.564970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.565620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.565901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.566173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.596667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.606861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03134aec-acb1-4884-b620-82dc5096e1b8 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.642884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.643579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.643922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.644305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.645166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:38.645474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.646911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.647171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.648443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.659327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 516/1049] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:38.665829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.759415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:38.768182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 534/1050] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:38.775638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.788394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7774c-d8ac-4379-8cca-8dad5c3590ef None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.824459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.825125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.825406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.825683 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.826506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] RBAC: Adding query filter params (role.id=c6a4d8714dca48f1ae4366549a8bd9f7, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=796757d15819413f8486471e778d95a6) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:38.826821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.828259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.834378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 517/1051] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/role_assignments?user.id=796757d15819413f8486471e778d95a6&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=c6a4d8714dca48f1ae4366549a8bd9f7 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:38.888886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420080-91df-4af0-8c2e-6271da2e4c75 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:38.928260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6004-7744-4c75-bedc-fef88a0a4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:38.930134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6004-7744-4c75-bedc-fef88a0a4146 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:38.930134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6004-7744-4c75-bedc-fef88a0a4146 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:38.930134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6004-7744-4c75-bedc-fef88a0a4146 None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:38.931184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6004-7744-4c75-bedc-fef88a0a4146 None admin] RBAC: Authorizing `identity:get_project(project_id=7aca501bb7c94b0eafa08438e7244aa5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:38.932722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6004-7744-4c75-bedc-fef88a0a4146 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:38.935567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 535/1052] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:38.940783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:38.959827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:39.069825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc6754-c77d-4727-86c9-d03006644595 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:39.109586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:39.110249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:39.110530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:39.110805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:39.111630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=7aca501bb7c94b0eafa08438e7244aa5, user.id=5b0dc5e0e3ee48c58947a5e5f985ac3e) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:39.111940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:39.113384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf43e9-8eaa-4bf9-ab70-8b07ca9b1bb8 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:39.119397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 518/1053] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:38 2022] GET /identity/v3/role_assignments?user.id=5b0dc5e0e3ee48c58947a5e5f985ac3e&scope.project.id=7aca501bb7c94b0eafa08438e7244aa5&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:39.527566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401766d-f74d-4bd6-bce9-0938df5be495 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:39.528119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401766d-f74d-4bd6-bce9-0938df5be495 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:39.528119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401766d-f74d-4bd6-bce9-0938df5be495 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:39.529474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 536/1054] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:39.534895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:39.535297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:39.535456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:39.554134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:39.555327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:39.629195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 519/1055] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:39.653336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401766d-f74d-4bd6-bce9-0938df5be495 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:39.726042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:39.761194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401766d-f74d-4bd6-bce9-0938df5be495 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:39.797558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:39.798269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:39.798551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:39.798876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:39.799526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:39.800965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:39.813585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:39.814658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 13:28:39.815562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:39.820222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 537/1056] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 8 13:28:39 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:39.821191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:39.831706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:39.924354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14531-fc55-430f-9d32-24392bd3f384 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:39.961758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:39.962469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:39.962763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:39.963039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:39.963793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:39.964265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:39.965628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:39.976029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 520/1057] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:39.977588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:40.083926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362c36-8067-40cf-9ee5-439e9e63f5f9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:40.122304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:40.127937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:40.128651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:40.128968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:40.130554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:40.130554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:40.130554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:40.132044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b408-3026-4169-a10c-718fcb1c44d9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:40.137151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 538/1058] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:40.143026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:40.221140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:40.254813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15c66-bca0-4ec1-a6d9-7e7e42f2edf4 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:40.291579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2652-afe7-44af-922d-d103fb61c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:40.292269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2652-afe7-44af-922d-d103fb61c11e None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:40.292553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2652-afe7-44af-922d-d103fb61c11e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:40.292824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2652-afe7-44af-922d-d103fb61c11e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:40.293573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2652-afe7-44af-922d-d103fb61c11e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:40.294922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2652-afe7-44af-922d-d103fb61c11e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:40.403098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 521/1059] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:28:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:28:41.084253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460a438-823e-4a30-adf2-9d80ac240a55 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.084887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460a438-823e-4a30-adf2-9d80ac240a55 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.084887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460a438-823e-4a30-adf2-9d80ac240a55 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.087618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 539/1060] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:41.092420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.092885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.092885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.110684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:41.111981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:41.189416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 522/1061] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:41.211627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460a438-823e-4a30-adf2-9d80ac240a55 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.321473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460a438-823e-4a30-adf2-9d80ac240a55 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:41.356421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144ee4-e70a-40b2-853f-a881a0b90e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:41.357157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144ee4-e70a-40b2-853f-a881a0b90e78 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.357438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144ee4-e70a-40b2-853f-a881a0b90e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.357729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144ee4-e70a-40b2-853f-a881a0b90e78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.369045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144ee4-e70a-40b2-853f-a881a0b90e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-04144ee4-e70a-40b2-853f-a881a0b90e78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:41.377107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:41.378135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:41.379113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 540/1062] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:41.384770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.422508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f75f8-9004-4c1a-a948-1b9c615d43ff None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.423114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f75f8-9004-4c1a-a948-1b9c615d43ff None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.423392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f75f8-9004-4c1a-a948-1b9c615d43ff None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.424932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 541/1063] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:41.429943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.430220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.430798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.445811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:41.448287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:41.449503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:41.498075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b479c28-3882-432e-aba6-2346a0e19bbf None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:41.504497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:41.522710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 542/1064] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:41.537706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:41.538380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.538665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.538944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.539690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:41.539997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:41.541391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:41.545522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.550164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 523/1065] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:41.558093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.651006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd723-6f40-4b30-b29b-7059eb8c6405 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:41.675586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319243a-2012-4277-9fd9-b2e7a28149d9 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:41.688003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:41.688833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.689113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.689385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.694883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:41.701164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:41.709171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:41.710309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:41.711222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 543/1066] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:41.716255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.719383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:41.720648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.720648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.720851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.733441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:41.735272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:41.753808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:41.756224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:41.757166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:41.757166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:41.757166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:41.757166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:41.760602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 524/1067] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:41.761725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.772834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:41.829478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d9d27-d869-4738-963a-de970527b364 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:41.865170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:41.865834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.866114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.866430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.867299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:41.867408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:41.868782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:41.870278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8fb9b-f00e-4653-99d8-343e7b647bab None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:41.877185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 544/1068] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:41.883083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.910982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:41.912605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:41.913184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:41.913467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:41.914874 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:41.915194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:41.917242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:41.930079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 525/1069] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:41.936120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:41.968522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:41.997625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632207-8945-4fcb-830f-8d09ec863ced None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.009543 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:42.042785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.043197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae962-e7ab-4b70-b67d-8c65e3bca196 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.044827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.045327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.046546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] PATH_INFO: `/v3/users/5b0dc5e0e3ee48c58947a5e5f985ac3e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.047991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0dc5e0e3ee48c58947a5e5f985ac3e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.049592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.051829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 545/1070] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/users/5b0dc5e0e3ee48c58947a5e5f985ac3e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:42.057487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.086109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.086914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.087310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.087584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.096349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.097828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:42.112848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:42.114079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:42.116823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 526/1071] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:28:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:42.120208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.175450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122e2b-fd0f-4252-9893-80431847b468 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.212480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.213341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.213615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.213883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.215108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] RBAC: Authorizing `identity:get_project(project_id=7aca501bb7c94b0eafa08438e7244aa5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.216580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.217100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:42.218515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 546/1072] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:42.224626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.230905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14bb70-2499-4826-b125-483ad55b81bf None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.270024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.270701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.271031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.271310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.272262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:42.272630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.273992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.275104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:42.293168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 527/1073] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:42.298343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.337438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d3c0-951a-4029-b808-b58880e4c007 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.377163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.378061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.378338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.378608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5/users/5b0dc5e0e3ee48c58947a5e5f985ac3e/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.380835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aca501bb7c94b0eafa08438e7244aa5, user_id=5b0dc5e0e3ee48c58947a5e5f985ac3e, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.382477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.406101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b6c5-ebd3-42fb-8e8c-2c7298daa0a7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.446323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.447138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.447471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.447799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.455989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 547/1074] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:42 2022] PUT /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5/users/5b0dc5e0e3ee48c58947a5e5f985ac3e/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:28:42.460674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.462350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.471065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:42.484620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:42.488290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:42.489206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:42.489206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:42.489206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:42.489206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:42.489206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 528/1075] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:42.492995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.606396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9395-c060-405f-8c9d-a603d2ac4b43 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.609081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:42.643191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.643861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.644170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.644445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.645165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:42.645469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.647390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1d89-b807-4bc1-8ab9-96a120b473ad None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.664131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 548/1076] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:42.666747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.769133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183b25-21db-446b-9056-07ddae16e7c0 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.769437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183b25-21db-446b-9056-07ddae16e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.769606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183b25-21db-446b-9056-07ddae16e7c0 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.771730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 549/1077] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:42.773984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f013-87fd-4307-9002-ac4f406b673c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:42.776781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.777065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.777349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.795554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:42.796981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:42.816476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:42.817284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:42.818083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:42.818478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:42.826730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:42.828903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:42.844506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:42.845549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:42.846640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:42.848751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 529/1078] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:42.855000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.876087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 550/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:42.899260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:42.921272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:42.981470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb6ce-c5d3-4a8a-8298-c536c8161398 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:43.002234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:43.009450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5163-2f0c-409e-add7-23dd77aa36df None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:43.020139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:43.020765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:43.021164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:43.021492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:43.022280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:43.022590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:43.024022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:43.038280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 530/1080] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:43.043808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:43.049420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:43.050165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:43.050460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:43.050737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:43.134324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:43.135869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:43.155186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb20dd4-2e71-4ec6-915a-de4873eb2264 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:43.173705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:43.193247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:43.194747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:43.194747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:43.195028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/796757d15819413f8486471e778d95a6/roles/c6a4d8714dca48f1ae4366549a8bd9f7` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:43.197262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=796757d15819413f8486471e778d95a6, role_id=c6a4d8714dca48f1ae4366549a8bd9f7)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:43.198690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:43.238519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:43.246212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 551/1081] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 13:28:43.252313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:43.310241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 531/1082] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:43 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/796757d15819413f8486471e778d95a6/roles/c6a4d8714dca48f1ae4366549a8bd9f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:28:43.368367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ee692-c727-4b42-9456-e7c6d4998826 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:43.406063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:43.406881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:43.407418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:43.407692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:43.420015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:43.421548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-08618e40-ab6a-4f71-8b92-971dd095021d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:43.440611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:43.441657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:43.442577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:43.442577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:43.442577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:43.442577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:43.444405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 552/1083] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:43.448601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:43.561941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd4c0-390c-4c19-810a-165310698170 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:43.598558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:43.599265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:43.599549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:43.599825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:43.600576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:43.600885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:43.602240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe62cc-b9d3-4058-aaeb-37a1ab30a610 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:43.613984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 532/1084] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:44.762004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46881d-745a-495a-bd1c-b779639c7359 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:44.762545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46881d-745a-495a-bd1c-b779639c7359 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:44.762545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46881d-745a-495a-bd1c-b779639c7359 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:44.763913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 553/1085] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:44.769335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:44.769769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:44.769863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:44.787747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:44.788950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:44.827566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:44.868849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 533/1086] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:44.892604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46881d-745a-495a-bd1c-b779639c7359 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:44.944151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:45.003803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46881d-745a-495a-bd1c-b779639c7359 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:45.045281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:45.046009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.046292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.046569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.058021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:45.065756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:45.066704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:45.067716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 554/1087] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:45.073102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:45.179059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135635b-948d-4491-b912-af0d2f0298d6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:45.218962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:45.220071 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.220574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.221152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.222466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:45.223044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:45.225479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:45.234813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 534/1088] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:45.241745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:45.358796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b6125-140f-4927-bc42-6bc0d40e8086 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:45.367395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:45.395239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d99723-1982-4acf-91bf-02637526aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:45.396475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99723-1982-4acf-91bf-02637526aa16 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.397079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99723-1982-4acf-91bf-02637526aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.397352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99723-1982-4acf-91bf-02637526aa16 None admin] PATH_INFO: `/v3/users/5b0dc5e0e3ee48c58947a5e5f985ac3e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.398563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d99723-1982-4acf-91bf-02637526aa16 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0dc5e0e3ee48c58947a5e5f985ac3e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:45.399994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d99723-1982-4acf-91bf-02637526aa16 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:45.401668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 555/1089] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/users/5b0dc5e0e3ee48c58947a5e5f985ac3e => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:45.407698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:45.441127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:45.515923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de02f2-705f-48a9-9f72-bfebcff053ca None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:45.566687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:45.568265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.568762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.569256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.654059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:45.656708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:45.686234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512682ef-f9cf-4528-9ff1-ee76a2a0caef None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.686670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512682ef-f9cf-4528-9ff1-ee76a2a0caef None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.687163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512682ef-f9cf-4528-9ff1-ee76a2a0caef None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.688853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 556/1090] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:28:45.693914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.694260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.694539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.697816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:45.715900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:45.719022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:45.778547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 535/1091] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 13:28:45.784586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:45.793999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 557/1092] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:28:45.818230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:45.885177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a12e7-3fc4-4a8e-93d8-fc1ecf15a80e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:45.913313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:45.917074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d8d7e-d309-4142-b5fd-e7f8934092c7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:45.918783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:45.919377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:45.919648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.919930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.920239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.921527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] RBAC: Authorizing `identity:get_project(project_id=7aca501bb7c94b0eafa08438e7244aa5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:45.922950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:45.927341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 536/1093] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:45.930745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:45.951808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:45.952647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:45.952934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:45.953208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:45.963713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:28:45.972559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:45.973730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 13:28:45.974883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:45.977409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 558/1094] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:45.982923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:46.033906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f7476-a9bd-4ca2-a03b-0e81e0b6bb8b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.067757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.068483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.068766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.069039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.069853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=7aca501bb7c94b0eafa08438e7244aa5, user.id=5b0dc5e0e3ee48c58947a5e5f985ac3e) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:46.070162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:46.071568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:46.077431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 537/1095] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/role_assignments?user.id=5b0dc5e0e3ee48c58947a5e5f985ac3e&scope.project.id=7aca501bb7c94b0eafa08438e7244aa5&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:46.079950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070919-bccf-4c12-aeee-7710fd9e5761 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.121948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.122648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.122933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.123242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.124013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:46.124358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:46.125759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:46.135449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 559/1096] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:28:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:28:46.141435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:46.208408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:46.250617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d5a6-1bc0-4a4f-bc6b-32b88c83c19e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.287229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.288026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.288364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.288638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.299126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:46.300600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:46.317705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:46.318873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:46.320004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:46.320004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:46.320004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:46.320004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:46.320004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 538/1097] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:46.325895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:46.355060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:46.433170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04354-d21f-4c45-af23-80123cc73f72 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.473501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.474060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.474341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.474615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.475326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:46.475632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:46.477177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:46.488776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 560/1098] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:46.495119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:46.593612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239cfb8-5836-4633-95aa-b5719b58e6b2 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.607722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:46.626844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.627636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.627913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.628272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.636819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:46.638252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:28:46.652606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:46.653727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:28:46.654694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 539/1099] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 8 13:28:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:28:46.659714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:46.742544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:46.757614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3762581-7782-42e4-a663-0d9c62c00176 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.793468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.794138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.794673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.794673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.795497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:46.795805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:46.797335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:46.814673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 561/1100] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 8 13:28:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:46.821248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:46.918834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9b370-6f04-476f-a02f-326a1c22ebe1 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:46.952089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:46.952737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:46.953019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:46.953295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:46.994181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:47.017606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:47.019098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:47.119086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 540/1101] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:47.124876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:47.222194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451ece-0938-4fb3-9bd9-17b68f5e095b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:47.259228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:47.259949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:47.260254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:47.260527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:47.270613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:47.272083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:47.274546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:28:47.290794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:47.291786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:47.292703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:28:47.292703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:28:47.292703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:28:47.292703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:47.292703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 562/1102] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:47.297670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:47.375788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:47.400320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a78d3-f2fa-4234-a132-3b915ea79862 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:47.434623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:47.435288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:47.435569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:47.435843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:47.436579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:47.436881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:47.438229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:47.449178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 541/1103] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:47.454761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:47.553703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b24b0-e14f-47bf-8850-6669dbd8ebaf None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:47.585923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:47.586717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:47.586996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:47.587268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:47.593741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:47.595185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:28:47.609075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:28:47.610131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:28:47.611446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 563/1104] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:28:47.616654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:47.716982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ad7ac-1dec-4a22-ab6c-e68584d94bf0 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:47.750941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:47.751600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:47.751882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:47.752259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:47.753044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:47.753357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:47.755747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cc412-b6c5-426f-95d4-7136e8a0c239 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:47.757358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:47.768179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 542/1105] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:47.774345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:47.830736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:47.874502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8b9c-4371-4b0d-8613-e435b785dbf3 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:47.907713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:47.908550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:47.908832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:47.909102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:47.909927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] RBAC: Adding query filter params (role.id=c6a4d8714dca48f1ae4366549a8bd9f7, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=796757d15819413f8486471e778d95a6) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:47.910233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:47.911911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f824e6-991f-439d-8922-8ae4ce5d0c46 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:47.917720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 564/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:47 2022] GET /identity/v3/role_assignments?user.id=796757d15819413f8486471e778d95a6&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=c6a4d8714dca48f1ae4366549a8bd9f7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:48.398052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5646-5947-4df6-a77f-ce17d4c9a0da None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:48.398553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5646-5947-4df6-a77f-ce17d4c9a0da None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:48.398553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff5646-5947-4df6-a77f-ce17d4c9a0da None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:48.399898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 543/1107] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:48.405389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:48.405677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:48.405955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:48.423781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:48.425003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:48.498257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 565/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:48.523133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff5646-5947-4df6-a77f-ce17d4c9a0da None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:48.630358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff5646-5947-4df6-a77f-ce17d4c9a0da None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:48.665621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53213b-5b6c-4722-a1f4-f4191679cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:48.666348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53213b-5b6c-4722-a1f4-f4191679cc88 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:48.666631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53213b-5b6c-4722-a1f4-f4191679cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:48.666907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53213b-5b6c-4722-a1f4-f4191679cc88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:48.668108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53213b-5b6c-4722-a1f4-f4191679cc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:48.669529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53213b-5b6c-4722-a1f4-f4191679cc88 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:48.671297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 544/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:48.677179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:48.726678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:48.776771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badec29c-49f9-46b6-ade9-d70a1a9d4adc None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:48.811081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa562b-5ed4-41e8-9533-1f09a6316a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:48.811751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa562b-5ed4-41e8-9533-1f09a6316a2c None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:48.812037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa562b-5ed4-41e8-9533-1f09a6316a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:48.812337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa562b-5ed4-41e8-9533-1f09a6316a2c None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:48.813051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa562b-5ed4-41e8-9533-1f09a6316a2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:48.814481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa562b-5ed4-41e8-9533-1f09a6316a2c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:48.903109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 566/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:28:48 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:28:51.216283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd807d6-22df-4dc6-9238-c4a0b12b4f37 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:51.216800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd807d6-22df-4dc6-9238-c4a0b12b4f37 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:51.216887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd807d6-22df-4dc6-9238-c4a0b12b4f37 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:51.218240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 545/1111] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:51.224608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:51.225020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:51.225173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:51.242236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:51.247556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:51.310560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 567/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:51.338045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd807d6-22df-4dc6-9238-c4a0b12b4f37 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:51.402115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:51.440998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd807d6-22df-4dc6-9238-c4a0b12b4f37 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:51.474388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:51.475432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:51.476216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:51.476561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] PATH_INFO: `/v3/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:51.478011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] RBAC: Authorizing `identity:get_role(role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:51.479371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:51.480759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 546/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:51 2022] GET /identity/v3/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:51.486736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:51.520877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:51.584111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e87293-fa1a-439d-8abb-6207497c6424 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:51.617683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:51.618571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:51.618854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:51.619129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] PATH_INFO: `/v3/users/06056755c27a49fe9e9dda037f5e6a58` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:51.632624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] RBAC: Authorizing `identity:get_user(user_id=06056755c27a49fe9e9dda037f5e6a58)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:51.635620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:51.637795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 568/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:51 2022] GET /identity/v3/users/06056755c27a49fe9e9dda037f5e6a58 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:51.643397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:51.741747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13537e8-59f2-4460-a61b-0392b09ecb36 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:51.769130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:51.775381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:51.776020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:51.776337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:51.776618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:51.841594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:51.843029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:51.938886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 547/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:51.944851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:52.034614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:52.041494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eae9d2-fbf9-481e-88c0-82a93408678b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:52.075109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7560c-601b-4fcb-bd5a-370cfa1be06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:52.075964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7560c-601b-4fcb-bd5a-370cfa1be06d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:52.076286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7560c-601b-4fcb-bd5a-370cfa1be06d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:52.076560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7560c-601b-4fcb-bd5a-370cfa1be06d None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:52.077735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7560c-601b-4fcb-bd5a-370cfa1be06d None admin] RBAC: Authorizing `identity:get_project(project_id=7aca501bb7c94b0eafa08438e7244aa5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:52.079160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7560c-601b-4fcb-bd5a-370cfa1be06d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:52.080873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 569/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:28:51 2022] GET /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:52.087839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:52.117308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:52.187158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812ead-0a18-4719-b756-9957b1b9ecbd None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:52.221007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:52.221659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:52.221943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:52.222224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:52.223351 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] RBAC: Adding query filter params (role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=7aca501bb7c94b0eafa08438e7244aa5, user.id=06056755c27a49fe9e9dda037f5e6a58) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:52.223662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:52.225149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7517ac-b55a-427e-b8e5-3c7c97d05c46 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:52.230590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 548/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:52 2022] GET /identity/v3/role_assignments?user.id=06056755c27a49fe9e9dda037f5e6a58&scope.project.id=7aca501bb7c94b0eafa08438e7244aa5&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:54.426948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71844d8-ea2a-4797-b38d-b68898d94b1b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:54.427478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71844d8-ea2a-4797-b38d-b68898d94b1b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:54.427478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71844d8-ea2a-4797-b38d-b68898d94b1b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:54.428806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 570/1118] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:54.434806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:54.435245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:54.435352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:54.451837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:54.453053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:54.519606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 549/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:54.543197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71844d8-ea2a-4797-b38d-b68898d94b1b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:54.640973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71844d8-ea2a-4797-b38d-b68898d94b1b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:54.673874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:54.674708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:54.674990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:54.675263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] PATH_INFO: `/v3/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:54.677582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] RBAC: Authorizing `identity:get_role(role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:54.678891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:54.680263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 571/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:54 2022] GET /identity/v3/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:54.685920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:54.710555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:54.786685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb575d5c-5199-41e2-afeb-201b0c98ac0e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:54.826288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:54.827159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:54.827439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:54.827709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] PATH_INFO: `/v3/users/06056755c27a49fe9e9dda037f5e6a58` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:54.828912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=06056755c27a49fe9e9dda037f5e6a58)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:54.830339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:54.831994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 550/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:54 2022] GET /identity/v3/users/06056755c27a49fe9e9dda037f5e6a58 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:54.837713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:54.867670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:54.933831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844988d9-21af-40a3-ad12-a6c9dabb7561 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:54.965421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40feb3-e0ac-4ce5-9bec-40360474191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:54.966258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40feb3-e0ac-4ce5-9bec-40360474191f None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:54.966533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40feb3-e0ac-4ce5-9bec-40360474191f None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:54.966798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40feb3-e0ac-4ce5-9bec-40360474191f None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:54.967945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40feb3-e0ac-4ce5-9bec-40360474191f None admin] RBAC: Authorizing `identity:get_project(project_id=7aca501bb7c94b0eafa08438e7244aa5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:54.969390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40feb3-e0ac-4ce5-9bec-40360474191f None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:54.971036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 572/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:28:54 2022] GET /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:54.977481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:55.065115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:55.076097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702754f-1fb4-40a2-a4e6-4628e13bc7e7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:55.111297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effc3ab-d54f-46a3-9abf-2226b9b8b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:55.112225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effc3ab-d54f-46a3-9abf-2226b9b8b0f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:55.112510 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effc3ab-d54f-46a3-9abf-2226b9b8b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:55.113635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effc3ab-d54f-46a3-9abf-2226b9b8b0f2 None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5/users/06056755c27a49fe9e9dda037f5e6a58/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:55.115929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effc3ab-d54f-46a3-9abf-2226b9b8b0f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aca501bb7c94b0eafa08438e7244aa5, user_id=06056755c27a49fe9e9dda037f5e6a58, role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:55.117381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effc3ab-d54f-46a3-9abf-2226b9b8b0f2 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:55.233926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 551/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:28:54 2022] PUT /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5/users/06056755c27a49fe9e9dda037f5e6a58/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:28:57.485824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ae79-84c3-4199-b5a8-e9c21f23947b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:57.486375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ae79-84c3-4199-b5a8-e9c21f23947b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:57.486375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ae79-84c3-4199-b5a8-e9c21f23947b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:57.488153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 573/1124] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:28:57.493568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:57.493980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:57.494130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:57.511117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:28:57.512334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:28:57.576708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 552/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:28:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:28:57.600699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244ae79-84c3-4199-b5a8-e9c21f23947b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:57.695440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:57.699673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244ae79-84c3-4199-b5a8-e9c21f23947b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:57.731193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:57.732030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:57.732336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:57.732602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] PATH_INFO: `/v3/roles/9dfebcd8f85d409ab6ae9ef48eb56668` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:57.734038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] RBAC: Authorizing `identity:get_role(role_id=9dfebcd8f85d409ab6ae9ef48eb56668)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:57.735463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:57.737145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 574/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:57 2022] GET /identity/v3/roles/9dfebcd8f85d409ab6ae9ef48eb56668 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:57.743516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:57.822849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:57.840643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7461b1a-2cc1-434d-9707-5148b13a756b None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:57.875295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:57.876182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:57.876468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:57.876743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] PATH_INFO: `/v3/users/06056755c27a49fe9e9dda037f5e6a58` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:57.878037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] RBAC: Authorizing `identity:get_user(user_id=06056755c27a49fe9e9dda037f5e6a58)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:57.879916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:57.881761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 553/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:28:57 2022] GET /identity/v3/users/06056755c27a49fe9e9dda037f5e6a58 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:57.887243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:57.983416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00592c-9803-4f41-af0d-1e1c6c64d3d9 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:58.016913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:58.017492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:58.017772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:58.018047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:58.049685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:58.082944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:58.084415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:58.181129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 575/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:28:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:28:58.186904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:58.283763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222c580-d915-4f8b-b352-93dfb0d9755c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:58.317319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f3f81-7e4a-436b-ae18-2e988885018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:58.318159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f3f81-7e4a-436b-ae18-2e988885018b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:58.318441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f3f81-7e4a-436b-ae18-2e988885018b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:58.318715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f3f81-7e4a-436b-ae18-2e988885018b None admin] PATH_INFO: `/v3/projects/7aca501bb7c94b0eafa08438e7244aa5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:58.319877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f3f81-7e4a-436b-ae18-2e988885018b None admin] RBAC: Authorizing `identity:get_project(project_id=7aca501bb7c94b0eafa08438e7244aa5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:58.321312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f3f81-7e4a-436b-ae18-2e988885018b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:58.322971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 554/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:28:58 2022] GET /identity/v3/projects/7aca501bb7c94b0eafa08438e7244aa5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:28:58.328935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:28:58.392000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:28:58.426056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb12e55-e0f2-490d-be86-8c23da9d2a7d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:28:58.465741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:28:58.466384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:28:58.466667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:28:58.466945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:28:58.467762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] RBAC: Adding query filter params (role.id=9dfebcd8f85d409ab6ae9ef48eb56668, scope.project.id=7aca501bb7c94b0eafa08438e7244aa5, user.id=06056755c27a49fe9e9dda037f5e6a58) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:28:58.468155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:28:58.469593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a35890-1d28-425a-a7d0-10ed64500858 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:28:58.476188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 576/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:28:58 2022] GET /identity/v3/role_assignments?user.id=06056755c27a49fe9e9dda037f5e6a58&scope.project.id=7aca501bb7c94b0eafa08438e7244aa5&role.id=9dfebcd8f85d409ab6ae9ef48eb56668 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:00.807472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff31a0-3936-4e68-959f-3ec276a11cbd None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:00.808022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff31a0-3936-4e68-959f-3ec276a11cbd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:00.808022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff31a0-3936-4e68-959f-3ec276a11cbd None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:00.809416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 555/1131] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:00.814542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:00.814989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:00.815083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:00.833040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:00.834198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:00.897582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 577/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:00.920776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff31a0-3936-4e68-959f-3ec276a11cbd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:00.939639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:01.020336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff31a0-3936-4e68-959f-3ec276a11cbd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:01.054862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeef7a-6da3-4b90-9e43-c59f0f2f1bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:01.055653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeef7a-6da3-4b90-9e43-c59f0f2f1bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:01.055932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeef7a-6da3-4b90-9e43-c59f0f2f1bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:01.056234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeef7a-6da3-4b90-9e43-c59f0f2f1bc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:01.057391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeef7a-6da3-4b90-9e43-c59f0f2f1bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:01.058857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeef7a-6da3-4b90-9e43-c59f0f2f1bc6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:01.060437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 556/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:01.066980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:01.125196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:01.164379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f47a86-b72b-4ba8-b9f1-07b0ba0ed230 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:01.198821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964bdb-011a-4ba3-a13c-c59170ab1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:01.199474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964bdb-011a-4ba3-a13c-c59170ab1c19 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:01.199756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964bdb-011a-4ba3-a13c-c59170ab1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:01.200031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964bdb-011a-4ba3-a13c-c59170ab1c19 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:01.200770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c964bdb-011a-4ba3-a13c-c59170ab1c19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:01.202198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c964bdb-011a-4ba3-a13c-c59170ab1c19 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:01.303065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 578/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:29:01 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:29:03.589054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4182-0a9d-46a6-a211-3a5cdbd234d1 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:03.589595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4182-0a9d-46a6-a211-3a5cdbd234d1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:03.589595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4182-0a9d-46a6-a211-3a5cdbd234d1 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:03.590943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 557/1135] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:03.596314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:03.596841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:03.597134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:03.613644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:03.614825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:03.680780 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 579/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:03.709769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4182-0a9d-46a6-a211-3a5cdbd234d1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:03.793829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:03.808853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4182-0a9d-46a6-a211-3a5cdbd234d1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:03.842597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3b2e2-a547-46af-87c3-815eba5766d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:03.843316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b2e2-a547-46af-87c3-815eba5766d3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:03.843596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b2e2-a547-46af-87c3-815eba5766d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:03.843868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b2e2-a547-46af-87c3-815eba5766d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:03.845052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3b2e2-a547-46af-87c3-815eba5766d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:03.846625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3b2e2-a547-46af-87c3-815eba5766d3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:03.848375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 558/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:03.854006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:03.896890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:03.951710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2670fb-acdc-45f2-8002-cb0447f774b4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:03.984743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ad032-89cc-4d4a-9cc0-f92307b0fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:03.985414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ad032-89cc-4d4a-9cc0-f92307b0fe31 None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:03.985694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ad032-89cc-4d4a-9cc0-f92307b0fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:03.985968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ad032-89cc-4d4a-9cc0-f92307b0fe31 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:03.987169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ad032-89cc-4d4a-9cc0-f92307b0fe31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:03.988634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ad032-89cc-4d4a-9cc0-f92307b0fe31 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:04.067291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 580/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:29:03 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:29:06.404347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae357e-8f70-4764-84e4-fb89f78ffd54 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:06.404855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae357e-8f70-4764-84e4-fb89f78ffd54 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:06.404855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae357e-8f70-4764-84e4-fb89f78ffd54 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:06.406439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 559/1139] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:06.412313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:06.412700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:06.412877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:06.429864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:06.431049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:06.497853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 581/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:06.521931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae357e-8f70-4764-84e4-fb89f78ffd54 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:06.621979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae357e-8f70-4764-84e4-fb89f78ffd54 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:06.654613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:06.655585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:06.655867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:06.656172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:06.666984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:29:06.675345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:06.676546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:29:06.677834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 560/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:06.682624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:06.708829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:06.778428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda422-cbbe-4b4b-9891-fc6c8f53b6a4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:06.812737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:06.813399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:06.813684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:06.813960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:06.815022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:06.815343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:06.816747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:06.824617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 582/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:06.830341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:06.846904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:06.930100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31b5c5-8254-4289-ad3c-b9b67d46f53b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:06.963047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:06.963908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:06.964223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:06.964502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] PATH_INFO: `/v3/users/a705ff1cee914d7abf8c0b250cc43ede` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:06.977944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] RBAC: Authorizing `identity:get_user(user_id=a705ff1cee914d7abf8c0b250cc43ede)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:06.979374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:06.981035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 561/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:29:06 2022] GET /identity/v3/users/a705ff1cee914d7abf8c0b250cc43ede => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:29:06.987162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:07.074258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:07.083925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d4ae5-f8f5-4943-baa5-0faa1885c497 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:07.118226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:07.118881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:07.119165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:07.119441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:07.185151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:07.186529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:07.278178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:07.289113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 583/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:29:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:29:07.295225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:07.364907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:07.393619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230be7-30dd-4da0-a5e6-8c13c1480dcf None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:07.429275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75770-545d-42ba-a932-554437685751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:07.430130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75770-545d-42ba-a932-554437685751 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:07.430413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75770-545d-42ba-a932-554437685751 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:07.430689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75770-545d-42ba-a932-554437685751 None admin] PATH_INFO: `/v3/projects/27c340baa12c45e7add99d02af23d372` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:07.431869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75770-545d-42ba-a932-554437685751 None admin] RBAC: Authorizing `identity:get_project(project_id=27c340baa12c45e7add99d02af23d372)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:07.433325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75770-545d-42ba-a932-554437685751 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:07.435027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 562/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:29:07 2022] GET /identity/v3/projects/27c340baa12c45e7add99d02af23d372 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:07.441712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:07.539710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9dbe-792b-4d97-9b89-4f770011dcae None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:07.573182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:07.573827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:07.574110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:07.574388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:07.575203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=27c340baa12c45e7add99d02af23d372, user.id=a705ff1cee914d7abf8c0b250cc43ede) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:07.575514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:07.576980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63938e-962e-4599-b8a4-2c89f8c20d58 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:07.582423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 584/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:29:07 2022] GET /identity/v3/role_assignments?user.id=a705ff1cee914d7abf8c0b250cc43ede&scope.project.id=27c340baa12c45e7add99d02af23d372&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:09.832701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da772c0-c638-4d39-808e-a85302ac20f2 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:09.833309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da772c0-c638-4d39-808e-a85302ac20f2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:09.833309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da772c0-c638-4d39-808e-a85302ac20f2 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:09.834591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 563/1147] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:09.839847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:09.840277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:09.840426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:09.857319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:09.858502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:09.907509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:09.924859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 585/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:09.947492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da772c0-c638-4d39-808e-a85302ac20f2 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:10.046781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da772c0-c638-4d39-808e-a85302ac20f2 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:10.079994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:10.081008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:10.081284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:10.081554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:10.091304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:10.092328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:29:10.100802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:10.102000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:29:10.103096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 564/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:10.108177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:10.208766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db21f6-f622-446f-a43d-4583cef0b20a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:10.242305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:10.242967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:10.243250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:10.243527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:10.244296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:10.244605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:10.245969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:10.254655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 586/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:29:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:10.260525 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:10.357707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb934e5-39c5-4b2b-b52e-148751c4b24e None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:10.390283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:10.391143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:10.391427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:10.391705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] PATH_INFO: `/v3/users/a705ff1cee914d7abf8c0b250cc43ede` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:10.393518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] RBAC: Authorizing `identity:get_user(user_id=a705ff1cee914d7abf8c0b250cc43ede)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:10.394929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:10.396569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 565/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:29:10 2022] GET /identity/v3/users/a705ff1cee914d7abf8c0b250cc43ede => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:10.402165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:10.451774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:10.512793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00508-e9ef-4be2-a9d0-3590dfb438a0 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:10.546975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81286adb-91c1-4c58-ae2b-89097000cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:10.547834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81286adb-91c1-4c58-ae2b-89097000cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:10.548168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81286adb-91c1-4c58-ae2b-89097000cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:10.548943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81286adb-91c1-4c58-ae2b-89097000cbb6 None admin] PATH_INFO: `/v3/projects/27c340baa12c45e7add99d02af23d372` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:10.550136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81286adb-91c1-4c58-ae2b-89097000cbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=27c340baa12c45e7add99d02af23d372)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:10.551566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81286adb-91c1-4c58-ae2b-89097000cbb6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:10.553303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 587/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:29:10 2022] GET /identity/v3/projects/27c340baa12c45e7add99d02af23d372 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:10.559283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:10.625164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:10.658036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedb20d-6d8c-49e1-9520-5f70e69f3cdc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:10.691857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917c4a-5f72-4568-a2e0-cce32c1fa6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:10.692770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917c4a-5f72-4568-a2e0-cce32c1fa6f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:10.693051 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917c4a-5f72-4568-a2e0-cce32c1fa6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:10.693326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917c4a-5f72-4568-a2e0-cce32c1fa6f4 None admin] PATH_INFO: `/v3/projects/27c340baa12c45e7add99d02af23d372/users/a705ff1cee914d7abf8c0b250cc43ede/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:10.695261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917c4a-5f72-4568-a2e0-cce32c1fa6f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=27c340baa12c45e7add99d02af23d372, user_id=a705ff1cee914d7abf8c0b250cc43ede, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:10.696707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917c4a-5f72-4568-a2e0-cce32c1fa6f4 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:10.774965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 566/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:29:10 2022] PUT /identity/v3/projects/27c340baa12c45e7add99d02af23d372/users/a705ff1cee914d7abf8c0b250cc43ede/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:29:13.034301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405adb7c-1595-4716-a1a9-077fca62ea5a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:13.034867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405adb7c-1595-4716-a1a9-077fca62ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:13.034867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405adb7c-1595-4716-a1a9-077fca62ea5a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:13.036362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 588/1154] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:13.041620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:13.042046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:13.042188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:13.059287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:13.060510 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:13.128044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 567/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:13.151247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405adb7c-1595-4716-a1a9-077fca62ea5a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:13.250458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405adb7c-1595-4716-a1a9-077fca62ea5a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:13.264208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:13.284251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:13.285085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:13.285307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:13.285576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:13.297086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:29:13.305144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:13.309567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:29:13.310727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 589/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:13.312346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:13.370322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:13.410888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cdfa1-4059-4822-be3b-e0002ccd8337 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:13.444377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:13.446036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:13.446326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:13.446601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:13.447337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:13.447640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:13.449022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:13.456948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 568/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:13.462662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:13.564670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669abd-aee2-4c14-a69c-a4637c13f168 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:13.597473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:13.598339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:13.598621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:13.598894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] PATH_INFO: `/v3/users/a705ff1cee914d7abf8c0b250cc43ede` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:13.600097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] RBAC: Authorizing `identity:get_user(user_id=a705ff1cee914d7abf8c0b250cc43ede)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:13.601529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:13.603135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 590/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:29:13 2022] GET /identity/v3/users/a705ff1cee914d7abf8c0b250cc43ede => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:13.608823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:13.708018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1488ca-af3c-47a0-bd36-02ef55e2d781 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:13.727873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:13.741692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:13.743258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:13.743258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:13.743258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:13.809536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:13.810966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:13.908671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 569/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:29:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:29:13.914487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:13.956998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:14.011915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847623e-a562-4e5f-8f9f-4e3ab0b9ba66 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:14.045753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63e1bd-28fd-466d-b279-52ad24ab495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:14.046597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63e1bd-28fd-466d-b279-52ad24ab495e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:14.046869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63e1bd-28fd-466d-b279-52ad24ab495e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:14.047133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63e1bd-28fd-466d-b279-52ad24ab495e None admin] PATH_INFO: `/v3/projects/27c340baa12c45e7add99d02af23d372` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:14.048990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63e1bd-28fd-466d-b279-52ad24ab495e None admin] RBAC: Authorizing `identity:get_project(project_id=27c340baa12c45e7add99d02af23d372)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:14.050413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63e1bd-28fd-466d-b279-52ad24ab495e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:14.052101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 591/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:29:13 2022] GET /identity/v3/projects/27c340baa12c45e7add99d02af23d372 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:14.058066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:14.078497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:14.158008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e10a8-e8d7-4311-95d9-6cc4f5d9177b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:14.191101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:14.191686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:14.191965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:14.192265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:14.193084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=27c340baa12c45e7add99d02af23d372, user.id=a705ff1cee914d7abf8c0b250cc43ede) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:14.193390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:14.194798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201bae-a66b-4df2-9dee-1c9be347d538 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:14.200489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 570/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:29:14 2022] GET /identity/v3/role_assignments?user.id=a705ff1cee914d7abf8c0b250cc43ede&scope.project.id=27c340baa12c45e7add99d02af23d372&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:16.465234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981837-381a-4f10-8581-f704cc08da49 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:16.465761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981837-381a-4f10-8581-f704cc08da49 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:16.465761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981837-381a-4f10-8581-f704cc08da49 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:16.467051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 592/1162] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:16.472432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:16.472825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:16.472982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:16.489311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:16.490473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:16.554250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 571/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:29:16.576922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981837-381a-4f10-8581-f704cc08da49 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:16.674784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981837-381a-4f10-8581-f704cc08da49 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:16.684916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:16.711014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:16.711650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:16.711931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:16.712235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:16.777336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:16.778703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:16.878917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 593/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:29:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:29:16.884873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:16.899950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:16.986501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c2ab7-4831-4277-bf0b-3314901518db None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:17.019335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:17.020153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:17.020437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:17.020714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:17.027513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:17.028915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-60e87828-acb3-4492-b49b-6e842ebc2137 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:17.043620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:17.044904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:29:17.045794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 572/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:29:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:17.051504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:17.062753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:17.147090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4274a-9b84-4efd-9e5f-bd44f846914a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:17.182061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:17.182721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:17.183005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:17.183278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:17.183991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:17.184331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:17.185706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046d27-2567-49fe-8e42-5204d4d5e459 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:17.192799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 594/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 8 13:29:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:29:19.404643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f906-cf71-439c-b195-c4a2036a1d23 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:19.405165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f906-cf71-439c-b195-c4a2036a1d23 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:19.405165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f906-cf71-439c-b195-c4a2036a1d23 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:19.407208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 573/1167] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:19.412372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a494f-1b80-4eca-a5dc-0ff5fa75982c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:19.412798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a494f-1b80-4eca-a5dc-0ff5fa75982c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:19.412930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a494f-1b80-4eca-a5dc-0ff5fa75982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:19.430437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-333a494f-1b80-4eca-a5dc-0ff5fa75982c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:19.431593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-333a494f-1b80-4eca-a5dc-0ff5fa75982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:19.496285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 595/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:19.518698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80f906-cf71-439c-b195-c4a2036a1d23 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:19.593092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:19.618935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80f906-cf71-439c-b195-c4a2036a1d23 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:19.651949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79a8c-17af-4db9-ac67-ed602eb1c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:19.652626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79a8c-17af-4db9-ac67-ed602eb1c9e1 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:19.652912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79a8c-17af-4db9-ac67-ed602eb1c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:19.653185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79a8c-17af-4db9-ac67-ed602eb1c9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:19.654186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79a8c-17af-4db9-ac67-ed602eb1c9e1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:19.655613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79a8c-17af-4db9-ac67-ed602eb1c9e1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:19.720584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 574/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Wed Jun 8 13:29:19 2022] POST /identity/v3/domains => generated 267 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:29:21.971008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c6f9-526d-4be7-84de-cf617893fd6a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:21.971547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c6f9-526d-4be7-84de-cf617893fd6a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:21.971547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c6f9-526d-4be7-84de-cf617893fd6a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:21.972941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 596/1170] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:21.978304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:21.978719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:21.978868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:21.995334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:21.996545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:22.062017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 575/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:22.085519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c6f9-526d-4be7-84de-cf617893fd6a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:22.089291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:22.183897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c6f9-526d-4be7-84de-cf617893fd6a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:22.215932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa332-f722-4d0b-832b-7ef585900b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:22.216801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa332-f722-4d0b-832b-7ef585900b51 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:22.217078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa332-f722-4d0b-832b-7ef585900b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:22.217342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa332-f722-4d0b-832b-7ef585900b51 None admin] PATH_INFO: `/v3/domains/5ac45d5e5d62404a9ca3d3767b0ba8a8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:22.228034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa332-f722-4d0b-832b-7ef585900b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ac45d5e5d62404a9ca3d3767b0ba8a8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:22.229428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa332-f722-4d0b-832b-7ef585900b51 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:22.231025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 597/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Jun 8 13:29:22 2022] GET /identity/v3/domains/5ac45d5e5d62404a9ca3d3767b0ba8a8 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:22.237084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:22.296964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:22.334570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445a00-c2e2-4a5d-8452-f7ed131e9db5 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:22.367811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac00faa-229e-470e-8851-518d4e2be5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:22.368492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac00faa-229e-470e-8851-518d4e2be5c6 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:22.368778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac00faa-229e-470e-8851-518d4e2be5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:22.369056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac00faa-229e-470e-8851-518d4e2be5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:22.369771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac00faa-229e-470e-8851-518d4e2be5c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:22.371179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac00faa-229e-470e-8851-518d4e2be5c6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:22.468746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 576/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:29:22 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:29:24.734077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907d59-6b67-48e7-b219-9d66d61b7002 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:24.734650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907d59-6b67-48e7-b219-9d66d61b7002 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:24.734756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907d59-6b67-48e7-b219-9d66d61b7002 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:24.736163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 598/1174] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:24.741285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:24.741668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:24.741834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:24.758780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:24.759935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:24.823804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 577/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:24.848834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907d59-6b67-48e7-b219-9d66d61b7002 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:24.911415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:24.949525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907d59-6b67-48e7-b219-9d66d61b7002 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:24.981942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5ada4-4ffb-4093-9bea-3864aae02b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:24.982801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ada4-4ffb-4093-9bea-3864aae02b1b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:24.983082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ada4-4ffb-4093-9bea-3864aae02b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:24.983353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ada4-4ffb-4093-9bea-3864aae02b1b None admin] PATH_INFO: `/v3/domains/5ac45d5e5d62404a9ca3d3767b0ba8a8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:24.985465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5ada4-4ffb-4093-9bea-3864aae02b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ac45d5e5d62404a9ca3d3767b0ba8a8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:24.986869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5ada4-4ffb-4093-9bea-3864aae02b1b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:24.988557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 599/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Jun 8 13:29:24 2022] GET /identity/v3/domains/5ac45d5e5d62404a9ca3d3767b0ba8a8 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:24.994439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:25.039697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:25.091700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911d013-aa9a-4702-9dee-1f5bf9479569 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:25.127147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d02d5-b28b-4f34-9ff0-951aa9874d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:25.127804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d02d5-b28b-4f34-9ff0-951aa9874d65 None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:25.128133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d02d5-b28b-4f34-9ff0-951aa9874d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:25.128526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d02d5-b28b-4f34-9ff0-951aa9874d65 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:25.129246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d02d5-b28b-4f34-9ff0-951aa9874d65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:25.130660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d02d5-b28b-4f34-9ff0-951aa9874d65 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:25.248536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 578/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:29:24 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:29:27.580380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8be9d5-cd9a-4564-9e90-ff996a93d411 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:27.580949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8be9d5-cd9a-4564-9e90-ff996a93d411 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:27.580949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8be9d5-cd9a-4564-9e90-ff996a93d411 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:27.582295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 600/1178] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:27.587482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:27.587919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:27.588037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:27.604977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:27.606137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:27.670347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 579/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:27.695246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8be9d5-cd9a-4564-9e90-ff996a93d411 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:27.796305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8be9d5-cd9a-4564-9e90-ff996a93d411 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:27.824292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:27.829479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:27.830260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:27.830591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:27.830812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:27.840966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:29:27.848529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:27.849667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:29:27.850751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 601/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:27.855722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:27.886246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:27.953481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e312b5-11e3-43c9-ad86-0c8480629929 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:27.986035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:27.986690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:27.986967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:27.987237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:27.987968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:27.988303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:27.989646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:27.997441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 580/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:28.004230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:28.102805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001118-ddf4-4492-a02f-375309244803 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:28.136984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:28.137843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:28.138123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:28.138395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] PATH_INFO: `/v3/users/13104c42a17348529c0a1c99c20e6bd1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:28.151353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] RBAC: Authorizing `identity:get_user(user_id=13104c42a17348529c0a1c99c20e6bd1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:28.152828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:28.154722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 602/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:29:28 2022] GET /identity/v3/users/13104c42a17348529c0a1c99c20e6bd1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:28.160540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:28.254804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:28.260992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dd5cc-94ce-4470-ae79-5afcfb55ab39 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:28.293263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:28.293895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:28.294172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:28.294443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:28.360044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:28.361466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:28.450640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:28.458637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 581/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:29:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:29:28.464730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:28.516091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:28.564237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395eb5f-1d3d-4a26-a11f-a2ad1cc269a7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:28.597160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282f459-c376-4ce0-8392-94f2ebbc5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:28.598012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282f459-c376-4ce0-8392-94f2ebbc5c27 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:28.598293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282f459-c376-4ce0-8392-94f2ebbc5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:28.598567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282f459-c376-4ce0-8392-94f2ebbc5c27 None admin] PATH_INFO: `/v3/projects/13a18462cb484a309730131656a1a0e1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:28.599733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282f459-c376-4ce0-8392-94f2ebbc5c27 None admin] RBAC: Authorizing `identity:get_project(project_id=13a18462cb484a309730131656a1a0e1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:28.601190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282f459-c376-4ce0-8392-94f2ebbc5c27 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:28.602864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 603/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:29:28 2022] GET /identity/v3/projects/13a18462cb484a309730131656a1a0e1 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:28.609767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:28.706473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3439-c092-4aaf-8b28-59bdabc7aa1c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:28.740107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:28.740773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:28.741042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:28.741317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:28.742184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=13a18462cb484a309730131656a1a0e1, user.id=13104c42a17348529c0a1c99c20e6bd1) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:28.742496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:28.743907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d916589-5812-4dfb-97cd-7a7907965f28 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:28.750327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 582/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:29:28 2022] GET /identity/v3/role_assignments?user.id=13104c42a17348529c0a1c99c20e6bd1&scope.project.id=13a18462cb484a309730131656a1a0e1&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:30.974251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c16c-5548-48b1-b63b-a39f7eb2c5ca None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:30.974798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c16c-5548-48b1-b63b-a39f7eb2c5ca None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:30.974798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c16c-5548-48b1-b63b-a39f7eb2c5ca None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:30.976161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 604/1186] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:30.981433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:30.981821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:30.981993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:31.001395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:31.002589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:31.055471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:31.069805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 583/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:29:31.093898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564c16c-5548-48b1-b63b-a39f7eb2c5ca None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:31.196899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564c16c-5548-48b1-b63b-a39f7eb2c5ca None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:31.213991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:31.230877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:31.231599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:31.231889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:31.232195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:31.243216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:29:31.252095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:31.253201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:29:31.254302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 605/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:31.259366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:31.355959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e4dc-3135-474e-8f14-4b5e49b1873a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:31.390464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:31.391118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:31.391404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:31.391677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:31.392443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:31.392750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:31.394100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:31.402064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 584/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:31.408293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:31.504696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a938d60-6352-44b9-8ac3-db2ac543b592 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:31.537385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:31.538251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:31.538530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:31.538805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] PATH_INFO: `/v3/users/13104c42a17348529c0a1c99c20e6bd1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:31.539972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] RBAC: Authorizing `identity:get_user(user_id=13104c42a17348529c0a1c99c20e6bd1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:31.541434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:31.543031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 606/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:29:31 2022] GET /identity/v3/users/13104c42a17348529c0a1c99c20e6bd1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:31.548750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:31.601665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:31.650596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d21c-58a2-44a7-bfc0-865c9bf4de36 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:31.683138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ebc28-a840-4163-9470-fd6b2dced8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:31.683989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ebc28-a840-4163-9470-fd6b2dced8cb None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:31.684321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ebc28-a840-4163-9470-fd6b2dced8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:31.684595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ebc28-a840-4163-9470-fd6b2dced8cb None admin] PATH_INFO: `/v3/projects/13a18462cb484a309730131656a1a0e1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:31.685761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ebc28-a840-4163-9470-fd6b2dced8cb None admin] RBAC: Authorizing `identity:get_project(project_id=13a18462cb484a309730131656a1a0e1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:31.687829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ebc28-a840-4163-9470-fd6b2dced8cb None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:31.689543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 585/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:29:31 2022] GET /identity/v3/projects/13a18462cb484a309730131656a1a0e1 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:31.695517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:31.740696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:31.792493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02af08-edae-429c-8b10-8e7f57686c30 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:31.825175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90c4fd-460c-4577-8c95-1a64e207f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:31.826050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c4fd-460c-4577-8c95-1a64e207f907 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:31.826329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c4fd-460c-4577-8c95-1a64e207f907 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:31.826628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c4fd-460c-4577-8c95-1a64e207f907 None admin] PATH_INFO: `/v3/projects/13a18462cb484a309730131656a1a0e1/users/13104c42a17348529c0a1c99c20e6bd1/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:31.828584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90c4fd-460c-4577-8c95-1a64e207f907 None admin] RBAC: Authorizing `identity:create_grant(project_id=13a18462cb484a309730131656a1a0e1, user_id=13104c42a17348529c0a1c99c20e6bd1, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:31.830003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90c4fd-460c-4577-8c95-1a64e207f907 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:31.900147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 607/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:29:31 2022] PUT /identity/v3/projects/13a18462cb484a309730131656a1a0e1/users/13104c42a17348529c0a1c99c20e6bd1/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:29:34.110360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e9a00-7540-48a0-a027-6dbfebf248c4 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:34.110852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e9a00-7540-48a0-a027-6dbfebf248c4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:34.110944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e9a00-7540-48a0-a027-6dbfebf248c4 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:34.112285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 586/1193] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:29:34.117394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:34.117784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:34.117943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:34.134291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:29:34.135468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:29:34.200203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 608/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:29:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:29:34.224298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e9a00-7540-48a0-a027-6dbfebf248c4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:34.322226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e9a00-7540-48a0-a027-6dbfebf248c4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:34.338967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:34.356196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:34.356196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:34.356196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:34.356196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:34.365822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:29:34.373909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:29:34.374995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:29:34.375856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:29:34.376551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 587/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:29:34.381080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:34.414844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:34.477555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b596-6381-42f9-b6a4-9dc0824031b9 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:34.510415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:34.511077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:34.511358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:34.511630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:34.512396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:34.512701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:34.514652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:34.522546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 609/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:34.528535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:34.624124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aa3a6-6e86-4183-aecd-e93b8d79cab2 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:34.656180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:34.657037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:34.657312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:34.657583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] PATH_INFO: `/v3/users/13104c42a17348529c0a1c99c20e6bd1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:34.658735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] RBAC: Authorizing `identity:get_user(user_id=13104c42a17348529c0a1c99c20e6bd1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:34.660182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:34.661766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 588/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 8 13:29:34 2022] GET /identity/v3/users/13104c42a17348529c0a1c99c20e6bd1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:34.667306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:34.760637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:34.764375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923f73-2959-485f-ae50-3771bf06b8d4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:34.797658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:34.798304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:34.798589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:34.798866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:34.863995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:34.865479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:34.960956 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:34.965628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 610/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:29:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:29:34.971813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:35.018580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:35.070883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5870-c3f0-48df-a9f0-6f173ba82111 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:35.105220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bca99-22de-4b6d-bbdd-2d0e6d5c09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:35.106086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bca99-22de-4b6d-bbdd-2d0e6d5c09de None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:35.106367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bca99-22de-4b6d-bbdd-2d0e6d5c09de None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:35.106644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bca99-22de-4b6d-bbdd-2d0e6d5c09de None admin] PATH_INFO: `/v3/projects/13a18462cb484a309730131656a1a0e1` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:35.108476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bca99-22de-4b6d-bbdd-2d0e6d5c09de None admin] RBAC: Authorizing `identity:get_project(project_id=13a18462cb484a309730131656a1a0e1)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:35.109831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bca99-22de-4b6d-bbdd-2d0e6d5c09de None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:35.111518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 589/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 8 13:29:34 2022] GET /identity/v3/projects/13a18462cb484a309730131656a1a0e1 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:35.117550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:29:35.213069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcedd85-573a-4c17-babc-febd0c1a4efb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:29:35.246336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:29:35.246977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:29:35.247260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:29:35.247535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:29:35.249088 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=13a18462cb484a309730131656a1a0e1, user.id=13104c42a17348529c0a1c99c20e6bd1) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:29:35.249421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:29:35.250846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b31f0a-7fdd-49a2-9552-bd7756f3baeb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:29:35.256601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 611/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:29:35 2022] GET /identity/v3/role_assignments?user.id=13104c42a17348529c0a1c99c20e6bd1&scope.project.id=13a18462cb484a309730131656a1a0e1&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:29:45.101050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=43 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:29:45.253962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=69 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:54.935313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949224c0-16b1-4d41-92c5-ae733de3d8f4 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:54.935908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949224c0-16b1-4d41-92c5-ae733de3d8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:54.935908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949224c0-16b1-4d41-92c5-ae733de3d8f4 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:54.937295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 590/1201] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:30:54.942951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:54.943362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:54.943488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:54.961142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:30:54.962331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:30:55.029128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 612/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:30:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:30:55.055560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949224c0-16b1-4d41-92c5-ae733de3d8f4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:55.158609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949224c0-16b1-4d41-92c5-ae733de3d8f4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:55.193492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:55.194193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:55.194472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:55.194744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:55.204716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:55.206192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:30:55.224474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:30:55.225630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:30:55.227176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:30:55.227176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:30:55.227176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:30:55.227176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:30:55.227176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 591/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:30:55.231558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:55.329526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596b276-75c4-4e6b-83b3-efb23f7f6847 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:55.357621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:55.364166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:55.364836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:55.365119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:55.365394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:55.366110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:30:55.366414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:55.367782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4cb3-40d6-4391-8101-2eda79122e05 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:55.379914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 613/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:30:55.385633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:55.441498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:55.489149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144747c-847d-4ee1-a7e7-8dbf132ed1d5 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:55.524309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ecbc-122f-487a-beaa-336d3bc61e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:55.524978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ecbc-122f-487a-beaa-336d3bc61e9f None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:55.525258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ecbc-122f-487a-beaa-336d3bc61e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:55.525533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ecbc-122f-487a-beaa-336d3bc61e9f None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:55.526244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ecbc-122f-487a-beaa-336d3bc61e9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:55.527676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ecbc-122f-487a-beaa-336d3bc61e9f None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:55.618726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 592/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 8 13:30:55 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:30:57.958846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe8e6f-f54b-4e85-9b8b-55141244469b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:57.959391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe8e6f-f54b-4e85-9b8b-55141244469b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:57.959391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe8e6f-f54b-4e85-9b8b-55141244469b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:57.960802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 614/1206] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:30:57.966149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:57.966608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:57.966703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:57.983818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:30:57.985051 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:30:58.053616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 593/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:30:58.077564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe8e6f-f54b-4e85-9b8b-55141244469b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:58.182070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe8e6f-f54b-4e85-9b8b-55141244469b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:58.215213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:58.215938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:58.216257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:58.216534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:58.227568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:30:58.235295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:30:58.242048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:30:58.243081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 615/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:30:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:30:58.246550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:58.286984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:58.347198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6afa2f-73d2-4700-bf84-9d9f4098b4da None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:58.383189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:58.383852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:58.384160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:58.384435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:58.385235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:30:58.385541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:58.386892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:58.394674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 594/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:30:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:30:58.401163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:58.453687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:58.505732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbf36f-00b3-4dc4-8b84-e841c4c732f6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:58.541466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:58.542256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:58.542531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:58.542797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:58.553325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:58.554749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:30:58.571668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:30:58.572624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:30:58.573609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:30:58.573609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:30:58.573609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:30:58.573609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:30:58.573609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 616/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:30:58.578725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:58.675957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:58.678955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b1445-9eaf-41b7-b7a5-82c3b167377b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:58.711664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:58.712356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:58.712637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:58.712910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:58.713617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:30:58.713920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:58.715269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:58.727156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 595/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:30:58.735675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:58.839799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a236-3600-418a-a1be-d38b735e03bc None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:58.841336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:58.872270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:58.873052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:58.873329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:58.873594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:58.881295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:58.882907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:30:58.898649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:30:58.899842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:30:58.901093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 617/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:30:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:30:58.906736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:59.007710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85108ad-84e8-4e3e-a8f0-dde744d86bc6 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:59.043570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:59.044273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:59.044553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:59.044823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:59.045716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:30:59.046017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:59.047421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:59.064197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 596/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 8 13:30:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:30:59.071027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:59.175274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80039d-5077-41d9-ade4-9bd69101fb05 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:59.210041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:59.210679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:59.210958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:59.211232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:59.240825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:59.278116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:59.279555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:59.376679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 618/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:30:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:30:59.382652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:59.401109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:59.481692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56d96-959b-48e6-b2ac-fee518dc1f45 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:59.517292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:59.518082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:59.518366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:59.518644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:59.528889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:59.532425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:30:59.548138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:30:59.549209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:30:59.550308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:30:59.550308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:30:59.550308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:30:59.550308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:30:59.550308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 597/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:30:59.555830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:59.617325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:59.655225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231525-5f22-43dd-91dc-03a247107ffd None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:59.689594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:59.690283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:59.690563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:59.690835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:59.691551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:30:59.691868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:59.693948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:59.706350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 619/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:30:59.712542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:59.782636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:30:59.813980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976de62d-7959-4d46-9cc4-cd7058dd0fbe None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:30:59.846895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:30:59.847691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:30:59.847975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:30:59.848281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:30:59.855689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:30:59.857158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:30:59.872448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:30:59.877570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:30:59.878759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 598/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:30:59.879998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:30:59.979666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ea13-ae70-44e7-bee3-e45a919995d4 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:00.001512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:00.012996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:00.013649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:00.013931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:00.014201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:00.014970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:00.015273 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:00.016721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4ae2-d789-4a26-a453-1a71a7940f75 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:00.028152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 620/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:31:00.034124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:00.137651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77961-d19b-4c3e-b804-c8cc85ff3388 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:00.167321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:00.173300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:00.173954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:00.174236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:00.174512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:00.175335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=f1f97e4500d842ffb91180058af0cbaa) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:00.175689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:00.177193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262c6b6-220a-4630-acfa-975862228588 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:00.182630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 599/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:31:00 2022] GET /identity/v3/role_assignments?user.id=f1f97e4500d842ffb91180058af0cbaa&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:02.385138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36c9a-30d4-44ee-b146-50e3073746cd None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:02.385672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36c9a-30d4-44ee-b146-50e3073746cd None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:02.385672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36c9a-30d4-44ee-b146-50e3073746cd None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:02.386962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 621/1220] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:02.392174 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:02.392579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:02.392729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:02.410294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:02.411474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:02.477572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 600/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:02.500044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36c9a-30d4-44ee-b146-50e3073746cd None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:02.602914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36c9a-30d4-44ee-b146-50e3073746cd None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:02.640383 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:02.641127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:02.641413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:02.641690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:02.652551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:31:02.660275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:02.661384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:02.662281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 622/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:31:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:02.669101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:02.767353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4e3ac-b916-4cb7-92c9-12cacd18b47e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:02.790963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:02.801175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:02.801872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:02.802152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:02.802425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:02.803155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:02.803457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:02.804832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:02.812627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 601/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:31:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:02.818468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:02.862253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:02.919266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9d0c-28a3-49c6-82df-86845cdda980 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:02.952355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:02.953149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:02.953432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:02.953704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:02.964316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:02.965892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:02.985976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:02.987110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:02.989350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:02.989350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:02.989350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:02.989350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:02.989350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 623/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:02.993988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:03.097719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410200-7e29-4570-834d-3c1fe53fcea7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:03.133557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:03.134210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:03.134486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:03.134754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:03.135460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:03.135757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:03.137172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:03.150001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 602/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:03.155652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:03.249895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:03.256393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304aaa8d-f53e-4ea7-a603-cf699cd364fb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:03.290856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:03.291768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:03.292079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:03.292371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:03.299902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:03.301402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:31:03.315809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:03.322432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:03.323663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 624/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:03.324405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:03.370624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:03.422191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5424aa1-36e5-424d-9c8e-1b254fc4f33d None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:03.454970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:03.455666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:03.455951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:03.456264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:03.457094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:03.457402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:03.458830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:03.477004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 603/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 8 13:31:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:03.482886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:03.581625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b26b-a081-42cf-b3fe-f9bde444dd1b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:03.614312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:03.615095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:03.615410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:03.615649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:03.625897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:03.627350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:03.644497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:03.648326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:03.649447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:03.649447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:03.649447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:03.649447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:03.649447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 625/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:03.652240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:03.750902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f723f-c839-4d29-923e-f59e0b6fd189 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:03.753358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:03.785251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:03.785951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:03.786235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:03.786513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:03.787270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:03.787573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:03.789026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:03.800409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 604/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:03.806456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:03.815726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:03.903716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741ea5-add4-430a-89c6-aa8e91f07022 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:03.937265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:03.938071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:03.938354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:03.938629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:03.945914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:03.947354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:31:03.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:03.967993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:03.969148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 626/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:03.969750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:04.069396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2edcc-11d6-44e6-b610-91f8abf8ab39 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:04.104974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:04.105636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:04.105916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:04.106190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:04.106972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:04.107276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:04.108741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f893-db5d-499d-b91b-767ead7d1485 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:04.121290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 605/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:04.127261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:04.191001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:04.223295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955f0a-bfba-4bff-ad5a-22a952251007 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:04.257384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8663171-07a9-45cb-abc1-93a25bdcc222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:04.258367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663171-07a9-45cb-abc1-93a25bdcc222 None admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:04.258654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663171-07a9-45cb-abc1-93a25bdcc222 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:04.258930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663171-07a9-45cb-abc1-93a25bdcc222 None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/f1f97e4500d842ffb91180058af0cbaa/roles/cd8217c0520e4220938b137b931f65f1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:04.272610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8663171-07a9-45cb-abc1-93a25bdcc222 None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=f1f97e4500d842ffb91180058af0cbaa, role_id=cd8217c0520e4220938b137b931f65f1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:04.274410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8663171-07a9-45cb-abc1-93a25bdcc222 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:04.419895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 627/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:31:04 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/f1f97e4500d842ffb91180058af0cbaa/roles/cd8217c0520e4220938b137b931f65f1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:31:06.633788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0ab0-9446-42db-a36c-3aff54654831 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:06.634387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0ab0-9446-42db-a36c-3aff54654831 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:06.634387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0ab0-9446-42db-a36c-3aff54654831 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:06.635801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 606/1233] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:06.641103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:06.641507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:06.641653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:06.657411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:06.658565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:06.724043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 628/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:06.747278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0ab0-9446-42db-a36c-3aff54654831 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:06.772344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:06.849161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0ab0-9446-42db-a36c-3aff54654831 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:06.885075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:06.885801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:06.886083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:06.886364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:06.896447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:31:06.904542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:06.910106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:06.911057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 607/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 8 13:31:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:06.911761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:06.959229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:07.010787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c0202-56a2-456b-8efa-d8571b4ee6ac None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:07.044216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:07.044883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:07.045162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:07.045431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:07.046157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] RBAC: Adding query filter params (name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:07.046457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:07.047822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:07.056797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 629/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 8 13:31:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:07.062473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:07.155085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:07.171705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747bdac-0249-4ce4-b154-b01df8019fc7 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:07.205491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:07.206281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:07.206560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:07.206835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:07.217392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:07.218838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:07.236225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:07.237136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:07.238087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:07.238087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:07.238087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:07.238087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:07.238087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 608/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:07.243397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:07.341229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203004-7442-4876-8cb4-1f1fe08ad071 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:07.350540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:07.376338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:07.377063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:07.377349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:07.377618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:07.378335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:07.378643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:07.380016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:07.391113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 630/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:07.397144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:07.497381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adefd0c-846f-4c78-9a27-0a72f10ee5d8 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:07.530912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:07.531757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:07.532041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:07.543886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:07.543886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:07.543886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:07.543886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:31:07.557608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:07.558776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:07.560164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 609/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:07.564622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:07.665107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8703a-f4ad-44e0-bd86-57235abea5c7 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:07.698618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:07.699283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:07.699572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:07.699847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:07.700716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:07.701026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:07.702488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:07.720305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 631/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 8 13:31:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:07.726093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:07.826485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f854-371d-4b5d-8d41-e2b9ce03919a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:07.860307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:07.860952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:07.861231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:07.861499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:07.921894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:07.928286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:07.929719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:08.026823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 610/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:31:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:31:08.032666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:08.060398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:08.132077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4680-bd7d-43b3-8336-fd67dfe0aca8 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:08.166661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:08.167445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:08.167726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:08.168001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:08.178091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:08.179528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:08.198125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:08.200476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:08.201627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:08.201627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:08.201627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:08.201627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:08.201627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 632/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:08.205005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:08.303480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:08.309260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89830041-0417-4017-bc6f-ca8b590078aa None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:08.342720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:08.343378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:08.343661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:08.343982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:08.344689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:08.344991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:08.346352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:08.357795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 611/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:08.363314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:08.442647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:08.463372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db653-146a-42a2-a9f5-d37940b59593 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:08.497730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:08.498517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:08.498795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:08.499064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:08.505837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:08.507692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:31:08.521788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:08.526329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:08.527468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 633/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:08.529006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:08.631502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe48eb-837b-4912-ae9f-1bbe9c3e04fd None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:08.664518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:08.665236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:08.665517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:08.665791 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:08.666815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:08.667127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:08.668571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5467ea-4f8a-4b39-9d53-8c755e9e45a1 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:08.680372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 612/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:31:08.687003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:08.786112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90b80-79c8-42ad-9acf-4405d2b83cbd None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:08.821404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:08.822131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:08.822413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:08.822692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:08.823514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] RBAC: Adding query filter params (role.id=cd8217c0520e4220938b137b931f65f1, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=f1f97e4500d842ffb91180058af0cbaa) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:08.823826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:08.825299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb6ec-412e-494c-b9c5-146a284b4cd1 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:08.831191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 634/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:31:08 2022] GET /identity/v3/role_assignments?user.id=f1f97e4500d842ffb91180058af0cbaa&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=cd8217c0520e4220938b137b931f65f1 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:31:11.105414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9336384-e42d-4c93-bcdc-b39a6f4f3a15 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:11.105938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9336384-e42d-4c93-bcdc-b39a6f4f3a15 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:11.105938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9336384-e42d-4c93-bcdc-b39a6f4f3a15 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:11.107303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 613/1247] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:11.112540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:11.112986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:11.113096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:11.118283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:11.131078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:11.132299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:11.198373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 635/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:11.221600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9336384-e42d-4c93-bcdc-b39a6f4f3a15 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:11.240171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:11.324766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9336384-e42d-4c93-bcdc-b39a6f4f3a15 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:11.359525 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:11.360270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:11.360552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:11.360828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:11.370841 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:31:11.378527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:11.379736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:11.380989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 614/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:31:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:11.386161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:11.484534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad890d7-f92f-4ceb-8f5c-272464365edf None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:11.513098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:11.517948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:11.518618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:11.518897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:11.519168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:11.519896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:11.520235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:11.521589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:11.529909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 636/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:11.535634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:11.612573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:11.635143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dd3c-98a5-4269-bd2e-7ea71dbdcc97 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:11.671654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:11.672461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:11.672740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:11.673014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:11.683191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:11.684736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:11.701746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:11.702880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:11.703972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:11.703972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:11.703972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:11.703972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:11.703972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 615/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:31:11.709362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:11.809753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909443e-3459-4610-b228-ea25a6c83d93 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:11.844190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:11.844856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:11.845136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:11.845407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:11.846118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:11.846422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:11.847816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:11.859541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 637/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:11.865395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:11.967464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c1d9-1e98-43d2-b357-88e96a6e3bc3 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:11.993673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:12.001589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:12.004015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:12.004015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:12.004015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:12.011076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:12.012541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:31:12.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:12.033725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:12.035110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 616/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:12.035879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:12.093472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:12.139542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605a7d-45f2-4b01-8c42-c043e2b07a3a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:12.173368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:12.174063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:12.174350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:12.174627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:12.175524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:12.175835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:12.177303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:12.195434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 638/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 8 13:31:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:12.202005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:12.302755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fe0e8-77ab-4c99-b3c7-8970c883d4fc None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:12.336895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:12.337539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:12.337860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:12.338179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:12.398387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:12.410392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:12.411859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:12.513931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 617/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:31:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:31:12.519971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:12.618149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e0e95-222d-41d0-8579-2784d87652c2 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:12.631396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:12.652539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:12.653408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:12.653690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:12.653961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:12.663760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:12.665231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:12.684243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:12.685428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:12.686519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:12.686519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:12.686519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:12.686519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:12.686519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 639/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:12.691256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:12.776587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:12.787961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9558d-cddb-4e62-9612-06f9a142c9ec None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:12.821368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:12.822016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:12.822295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:12.822589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:12.823300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:12.823595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:12.824993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:12.835883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 618/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:12.842262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:12.941782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb93ff-96de-40c8-bea9-76bd565b2e8a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:12.975584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:12.976397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:12.976679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:12.976950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:12.984169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:12.985602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:31:12.999357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:13.000449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:13.001369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 640/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:13.006663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:13.109748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d7573-18a9-44f1-8fba-447391cdde7b None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:13.143337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:13.143989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:13.144301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:13.144579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:13.145347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:13.145653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:13.147058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4326d33-91c4-4250-8a1d-170fdc7f4adf None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:13.159383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 619/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:31:13.165574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:13.193622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:13.268589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206adb0-5116-4e47-9330-fcbf4330f5c6 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:13.303770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:13.304468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:13.304813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:13.305126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:13.306007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=f1f97e4500d842ffb91180058af0cbaa) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:13.306335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:13.307822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a8566-8be4-435a-9549-5a80b5675431 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:13.313350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 641/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:31:13 2022] GET /identity/v3/role_assignments?user.id=f1f97e4500d842ffb91180058af0cbaa&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=06c074382d5e4a2893d59028af60fee8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:15.573391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865ddb8-9f1a-4ef4-8d7a-c91ff134de57 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:15.575209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865ddb8-9f1a-4ef4-8d7a-c91ff134de57 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:15.575209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865ddb8-9f1a-4ef4-8d7a-c91ff134de57 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:15.575953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 620/1261] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:15.581290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:15.581716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:15.581857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:15.600246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:15.601436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:15.670412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 642/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 13:31:15.693628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865ddb8-9f1a-4ef4-8d7a-c91ff134de57 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:15.704924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:15.797095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865ddb8-9f1a-4ef4-8d7a-c91ff134de57 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:15.831943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:15.832726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:15.833011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:15.833288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:15.844395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:31:15.852089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:15.853192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:15.854204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 621/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:15.859516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:15.878897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:15.960683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23f2a3-28f7-4e40-a559-147810cb845b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:15.995049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:15.996272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:15.996555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:15.996887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:15.997647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:15.997983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:15.999384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:16.007237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 643/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:16.013921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:16.080759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:16.115535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef22c5-b0a3-403f-b172-5cd8238731c8 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:16.148988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:16.149763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:16.150046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:16.150326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:16.161299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:16.172090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:16.179695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:16.180761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:16.181960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:16.181960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:16.181960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:16.181960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:16.184209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 622/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:16.187437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:16.273280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:16.293900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa1347-ce44-42a4-9c09-dca87c251885 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:16.328802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:16.329465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:16.329748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:16.330071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:16.330796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:16.331100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:16.332527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:16.345515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 644/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:16.351208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:16.456673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941a3b-2a55-442c-9f34-e80d4d2caa25 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:16.477127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:16.492129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:16.492931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:16.493214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:16.493489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:16.501621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:16.503095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:31:16.518277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:16.530031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:16.531194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 623/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:16.531947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:16.626946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609c025-0f88-4b2a-8f57-3c3b4946b060 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:16.660823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:16.661539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:16.661863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:16.662123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:16.662938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:16.663240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:16.664686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:16.673882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:16.682381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 645/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 8 13:31:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:16.688432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:16.786103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68b566-778e-4725-9872-0f1e9ebf0449 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:16.819980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:16.820798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:16.821081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:16.821354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:16.832201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:16.833630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:16.850164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:16.851322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:16.852301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:16.852301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:16.852301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:16.852301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:16.852301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 624/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:16.857646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:16.961951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e2a8-b72e-49f7-b832-64231b7e4f7e None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:16.996751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:16.997456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:16.997743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:16.998019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:16.998728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:16.999030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:17.000435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:17.011895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 646/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:31:17.017708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:17.050420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:17.118543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdfc30-ee50-4483-99a9-7c827c26107a None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:17.152905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:17.153691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:17.154073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:17.154355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:17.160930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:17.162353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:31:17.177056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:17.180106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:17.181243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 625/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:17.185432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:17.244208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:17.285250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9d438-56a6-4911-9647-596ce6a6cffe None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:17.320263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:17.321146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:17.321597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:17.322381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:17.323160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:17.323468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:17.324930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad90291-8b43-4abf-bc69-33207a9f1d71 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:17.337154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 647/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:17.343697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:17.438140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:17.446274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af39f3-9d44-4665-804d-cca8a0284c28 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:17.478480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e24d1-4183-4649-af37-ed4bcbf905ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:17.479352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e24d1-4183-4649-af37-ed4bcbf905ed None admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:17.479628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e24d1-4183-4649-af37-ed4bcbf905ed None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:17.479899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e24d1-4183-4649-af37-ed4bcbf905ed None admin] PATH_INFO: `/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/f1f97e4500d842ffb91180058af0cbaa/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:17.482480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e24d1-4183-4649-af37-ed4bcbf905ed None admin] RBAC: Authorizing `identity:create_grant(project_id=818e7e7f694d40c5aa48e4a883b3dc0c, user_id=f1f97e4500d842ffb91180058af0cbaa, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:17.483893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e24d1-4183-4649-af37-ed4bcbf905ed None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:17.544292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 626/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 8 13:31:17 2022] PUT /identity/v3/projects/818e7e7f694d40c5aa48e4a883b3dc0c/users/f1f97e4500d842ffb91180058af0cbaa/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:31:19.815167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828beb39-8d21-49fd-b0f2-c627c017a044 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:19.815734 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828beb39-8d21-49fd-b0f2-c627c017a044 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:19.815832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828beb39-8d21-49fd-b0f2-c627c017a044 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:19.817290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 648/1274] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:19.822567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:19.823002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:19.823103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:19.840241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:19.841460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:19.907091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 627/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:19.931120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828beb39-8d21-49fd-b0f2-c627c017a044 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:20.036755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828beb39-8d21-49fd-b0f2-c627c017a044 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:20.055503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:20.072396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:20.073122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:20.073404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:20.073696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:20.083977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 13:31:20.091933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:20.093240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:20.094128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 649/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 8 13:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:20.099219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:20.183590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:20.202328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f891-894e-481d-be04-f872dac31cb7 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:20.235918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:20.236615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:20.236906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:20.237177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:20.237956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:20.238261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:20.239622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:20.248204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 628/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 8 13:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:20.254034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:20.355134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e07f39-c413-4ba4-abb3-cbc6de7ba51a None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:20.389249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:20.390031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:20.390311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:20.390581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:20.400923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:20.402349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:20.420513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:20.421877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:20.423228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:20.423228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:20.423228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:20.423228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:20.423228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 650/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:20.427938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:20.538553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c09a6-bbc9-4263-9773-772739d8ac85 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:20.575862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:20.576784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:20.577070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:20.577343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:20.578084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:20.578386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:20.579792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:20.593656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 629/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:20.599670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:20.632592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:20.710183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0897c-cc2b-42c4-8048-32f94d305d86 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:20.747271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:20.748854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:20.749141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:20.749417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:20.757876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:20.759350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 13:31:20.774776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:20.781168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:20.782490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 651/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:20.784766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:20.789584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:20.890170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3043b3e-3254-45d5-88ee-179de66d7bba None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:20.926369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:20.927061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:20.927343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:20.927641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:20.928561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:20.928870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:20.930297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:20.949086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 630/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 8 13:31:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:20.954694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:21.047983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:21.058777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f305-c24a-4b4f-8bc7-04dead69494d None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:21.094516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:21.095178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:21.095462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:21.095740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:21.164132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:21.165535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:21.253474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:21.263831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 652/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 8 13:31:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 13:31:21.269818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:21.331235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:21.369620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ebd3-4866-4826-8077-8d3167542b4c None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:21.402875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:21.403705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:21.404391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:21.404391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:21.414733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:21.416265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 13:31:21.433158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:21.434243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:21.436357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 13:31:21.436357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 13:31:21.436357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 13:31:21.436357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:21.436357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 631/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:21.441732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:21.540740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746600aa-69ef-42e1-97c1-cdcb29a9d950 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:21.576257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:21.576923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:21.577206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:21.577481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:21.578190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:21.578493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:21.579869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:21.591062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 653/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 8 13:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:21.596946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:21.704879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834782e-4c39-4f8f-8fa8-9af491282b40 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:21.718327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:21.738268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:21.739060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:21.739341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:21.739627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:21.746099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:21.748177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 13:31:21.764734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:21.765999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: ERROR keystone.server.flask.application Jun 08 13:31:21.766966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 632/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 8 13:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:21.771904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:21.821671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:21.870407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e22d-f765-43a6-92dd-b6b2e39870bb None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:21.902775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:21.903426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:21.903706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:21.904581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:21.905570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:21.905885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:21.907529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d57d8-96e5-46bb-bead-d54a441bfa4c None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:21.920753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 654/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 8 13:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:21.927075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:22.025869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816fe67-f88d-48ce-9c33-727d51dba896 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:22.060037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:22.061015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:22.061304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:22.061586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:22.062413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] RBAC: Adding query filter params (role.id=06c074382d5e4a2893d59028af60fee8, scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c, user.id=f1f97e4500d842ffb91180058af0cbaa) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:22.062749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:22.064186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab819-907d-4365-94b3-685e68a5f378 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:22.070055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 633/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 8 13:31:21 2022] GET /identity/v3/role_assignments?user.id=f1f97e4500d842ffb91180058af0cbaa&scope.project.id=818e7e7f694d40c5aa48e4a883b3dc0c&role.id=06c074382d5e4a2893d59028af60fee8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:24.350534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091819-1cac-47b3-a93c-98e5995ad398 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:24.351102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091819-1cac-47b3-a93c-98e5995ad398 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:24.351102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091819-1cac-47b3-a93c-98e5995ad398 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:24.352426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 655/1288] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:24.357718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:24.358166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:24.358269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:24.375128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:24.376333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:24.405911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:24.443309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 634/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:24.465146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4091819-1cac-47b3-a93c-98e5995ad398 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:24.565114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4091819-1cac-47b3-a93c-98e5995ad398 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:24.575700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:24.598666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:24.599462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:24.599744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:24.600020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:24.600750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:24.602074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:24.615018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:24.616313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:24.617211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 656/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:31:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:24.622371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:24.719962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184913db-f23c-4195-90de-a4f81fb58a2f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:24.754850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:24.755547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:24.755827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:24.756124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:24.760566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:24.760566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:24.760566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f645b-7bbf-41b3-829a-4c8d79cbaa68 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:24.763247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 635/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 8 13:31:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:24.769269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:24.871992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84e0e-3073-4d1d-a1e5-dc9ac868b812 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:24.904157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:24.905331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:24.905612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:24.905885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] PATH_INFO: `/v3/services` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:24.906579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:24.906881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:24.908265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da361-028f-43c9-aefa-a95e3b11b330 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:24.912640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 657/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 8 13:31:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:27.181066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556858e-78c8-477d-8068-f6d0a857e8c3 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:27.181632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556858e-78c8-477d-8068-f6d0a857e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:27.181632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556858e-78c8-477d-8068-f6d0a857e8c3 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:27.182988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 636/1293] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:27.188577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333709a2-9480-4a3a-9142-9a355bfee8b2 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:27.198206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333709a2-9480-4a3a-9142-9a355bfee8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:27.198206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333709a2-9480-4a3a-9142-9a355bfee8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:27.206067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-333709a2-9480-4a3a-9142-9a355bfee8b2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:27.207345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-333709a2-9480-4a3a-9142-9a355bfee8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:27.237375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:27.273144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 658/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:27.299119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556858e-78c8-477d-8068-f6d0a857e8c3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:27.330192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:27.401059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556858e-78c8-477d-8068-f6d0a857e8c3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:27.436062 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4a7d6-3aa9-4481-b937-eeec9a45437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:27.436803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4a7d6-3aa9-4481-b937-eeec9a45437c None admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:27.437240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4a7d6-3aa9-4481-b937-eeec9a45437c None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:27.437520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4a7d6-3aa9-4481-b937-eeec9a45437c None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:27.438281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4a7d6-3aa9-4481-b937-eeec9a45437c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:27.439688 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4a7d6-3aa9-4481-b937-eeec9a45437c None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:27.514186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 637/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 8 13:31:27 2022] POST /identity/v3/services => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:31:29.798299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536433c2-ff6b-48c0-8fc9-e3df88b94a60 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:29.798862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536433c2-ff6b-48c0-8fc9-e3df88b94a60 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:29.798862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536433c2-ff6b-48c0-8fc9-e3df88b94a60 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:29.800554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 659/1296] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:29.805956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:29.806487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:29.806599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:29.823380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:29.824566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:29.901069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 638/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:29.924315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536433c2-ff6b-48c0-8fc9-e3df88b94a60 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:30.024876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536433c2-ff6b-48c0-8fc9-e3df88b94a60 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:30.059146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:30.059891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:30.060202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:30.060477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:30.061120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:30.062486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:30.074490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:30.082092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:30.083196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 660/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:31:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 13:31:30.084204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:30.101914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:30.180591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642128f-34c5-402d-906c-9a8fc1a8566e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:30.215262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:30.215931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:30.216252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:30.216530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:30.217471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:30.217789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:30.219554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:30.224843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 639/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 8 13:31:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:30.230696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:30.261600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:30.328104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff12e-53ce-47a8-9b2e-c2ff1bd21f6b None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:30.360571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:30.361215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:30.361496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:30.361770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:30.362542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] RBAC: Adding query filter params (interface=public, service_id=2170e3ac00b240e4aaa8545f9666182a, region_id=RegionOne) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:30.362874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:30.364384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac2d0-41f8-4b3f-a5e4-1665b041bd23 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:30.369907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 661/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 8 13:31:30 2022] GET /identity/v3/endpoints?service_id=2170e3ac00b240e4aaa8545f9666182a&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:30.376197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:30.456245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:30.474170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b816f9f-2d2f-4758-a9a3-1149365b5830 None admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:30.507524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c379d0c-6269-4fc9-bc39-578e369ef318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:30.508217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379d0c-6269-4fc9-bc39-578e369ef318 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:30.508501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379d0c-6269-4fc9-bc39-578e369ef318 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:30.508773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379d0c-6269-4fc9-bc39-578e369ef318 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:30.509443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c379d0c-6269-4fc9-bc39-578e369ef318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:30.510789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c379d0c-6269-4fc9-bc39-578e369ef318 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:30.517713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 640/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 8 13:31:30 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:31:32.802876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f1a9-7576-47bc-b12f-0d855ecfb60c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:32.803420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f1a9-7576-47bc-b12f-0d855ecfb60c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:32.803420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f1a9-7576-47bc-b12f-0d855ecfb60c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:32.804823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 662/1302] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:31:32.810144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:32.810589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:32.810704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:32.827961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:31:32.829761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:31:32.897231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 641/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:31:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 13:31:32.920976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92f1a9-7576-47bc-b12f-0d855ecfb60c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:33.016448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:33.023028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92f1a9-7576-47bc-b12f-0d855ecfb60c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:33.057083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:33.057793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:33.058076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:33.058353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:33.059003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:33.060387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 13:31:33.073508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 13:31:33.074731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application with Lock( Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self._enter() Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application return self.creator() Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application created_value = creator( Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: ERROR keystone.server.flask.application Jun 08 13:31:33.075818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 663/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 8 13:31:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 13:31:33.081407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:33.159219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:33.182402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1115c-eae7-4d3f-9fa3-0079eb5b9c58 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:33.216096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:33.216802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:33.217083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:33.217361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] PATH_INFO: `/v3/services` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:33.218063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:31:33.218368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:33.220237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b66785-e3de-40e8-8cc1-8eeb68606223 None admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:33.225448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 642/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 8 13:31:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:31:33.231349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:31:33.332923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e5e6c-393f-45ea-b8c8-7aabc8029e74 None admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:31:33.368036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a40c93-a715-4fa6-805a-1fdc20dd790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:31:33.368717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40c93-a715-4fa6-805a-1fdc20dd790b None admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:31:33.369001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40c93-a715-4fa6-805a-1fdc20dd790b None admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:31:33.369282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40c93-a715-4fa6-805a-1fdc20dd790b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:31:33.370006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a40c93-a715-4fa6-805a-1fdc20dd790b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:31:33.371500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a40c93-a715-4fa6-805a-1fdc20dd790b None admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:31:33.441292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 664/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 8 13:31:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:31:43.222394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=30 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:31:43.436600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:04.801680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab09806-0b50-43c1-b231-f42e2e7dace5 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:04.802258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab09806-0b50-43c1-b231-f42e2e7dace5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:04.802258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab09806-0b50-43c1-b231-f42e2e7dace5 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:04.808907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454cc5d-18ac-4cdb-86d6-5e7e26d9b8a7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:04.809356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454cc5d-18ac-4cdb-86d6-5e7e26d9b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:04.809446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454cc5d-18ac-4cdb-86d6-5e7e26d9b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:04.813527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 643/1307] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:38:04.886891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f454cc5d-18ac-4cdb-86d6-5e7e26d9b8a7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:04.888002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f454cc5d-18ac-4cdb-86d6-5e7e26d9b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:05.009607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 665/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:05.062718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04ed3-4586-4e0b-aa8c-ceddb460a7d9 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:05.063250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04ed3-4586-4e0b-aa8c-ceddb460a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:05.063676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04ed3-4586-4e0b-aa8c-ceddb460a7d9 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:05.066163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 644/1309] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jun 8 13:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:05.073805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a4bb3-4ae6-493a-9c30-0aee2d51be01 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:05.074183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a4bb3-4ae6-493a-9c30-0aee2d51be01 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:05.074563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a4bb3-4ae6-493a-9c30-0aee2d51be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:05.196223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e74a4bb3-4ae6-493a-9c30-0aee2d51be01 None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:05.197940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e74a4bb3-4ae6-493a-9c30-0aee2d51be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:05.225976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:05.311787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 666/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jun 8 13:38:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:38:05.312664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04ed3-4586-4e0b-aa8c-ceddb460a7d9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:05.314409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-71f04ed3-4586-4e0b-aa8c-ceddb460a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:05.457141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04ed3-4586-4e0b-aa8c-ceddb460a7d9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:05.543989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:05.544848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:05.545203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:05.545547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:05.547269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:05.609490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:05.672271 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:05.673708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abccf4-6e30-4688-be45-1a5f532e91be service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:05.693765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 645/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:08.256090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9669195-93c2-4d0f-a2ef-452dfcc00dc2 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:08.256696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9669195-93c2-4d0f-a2ef-452dfcc00dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:08.256696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9669195-93c2-4d0f-a2ef-452dfcc00dc2 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:08.258497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 667/1312] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:08.264230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c22776-f68e-4a04-a997-feff36103170 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:08.264673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c22776-f68e-4a04-a997-feff36103170 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:08.264789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c22776-f68e-4a04-a997-feff36103170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:08.348515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c3c22776-f68e-4a04-a997-feff36103170 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:08.349764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c3c22776-f68e-4a04-a997-feff36103170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:08.451805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 646/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:08.502549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194475-b8e0-45ac-940f-5cf74a773043 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:08.502834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194475-b8e0-45ac-940f-5cf74a773043 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:08.503112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194475-b8e0-45ac-940f-5cf74a773043 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:08.504572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 668/1314] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jun 8 13:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:08.510928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844e39-aea9-4b4a-a2c4-b05f87be16bf None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:08.511292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844e39-aea9-4b4a-a2c4-b05f87be16bf None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:08.511626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844e39-aea9-4b4a-a2c4-b05f87be16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:08.523656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:08.740386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d5844e39-aea9-4b4a-a2c4-b05f87be16bf None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:08.741625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d5844e39-aea9-4b4a-a2c4-b05f87be16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:08.825659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 647/1315] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jun 8 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:08.834700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194475-b8e0-45ac-940f-5cf74a773043 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:08.836291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-44194475-b8e0-45ac-940f-5cf74a773043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:08.949733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194475-b8e0-45ac-940f-5cf74a773043 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:09.029554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:09.032133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:09.032792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:09.033071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:09.033345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:09.035118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:09.154726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:09.156347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc3005-0ccf-4040-b5be-d512ce71a293 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:09.176691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 669/1316] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:12.246556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468c666-c607-4a77-bfa7-2354df0bf62a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:12.247182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468c666-c607-4a77-bfa7-2354df0bf62a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:12.247182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468c666-c607-4a77-bfa7-2354df0bf62a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:12.248799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 648/1317] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:12.253976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59149f5a-5104-4965-ae31-f110ce7dfc0a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:12.254381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59149f5a-5104-4965-ae31-f110ce7dfc0a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:12.254520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59149f5a-5104-4965-ae31-f110ce7dfc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:12.318030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-59149f5a-5104-4965-ae31-f110ce7dfc0a None None] MFA Rules not processed for user `d79d89fc90a74e709dc9387801d50cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:12.319205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-59149f5a-5104-4965-ae31-f110ce7dfc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:12.370124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:12.414235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 670/1318] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:12.454068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468c666-c607-4a77-bfa7-2354df0bf62a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:12.455608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4468c666-c607-4a77-bfa7-2354df0bf62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:12.557037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468c666-c607-4a77-bfa7-2354df0bf62a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:12.559834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:12.630106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:12.630668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:12.630942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:12.631208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:12.632866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:12.738636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:12.740091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce4cb-6f35-45a9-9013-53c1a39167ed service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:12.758003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 649/1319] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:15.821417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d2fc-84ab-48af-a9b8-2f972648b474 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:15.821988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d2fc-84ab-48af-a9b8-2f972648b474 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:15.821988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d2fc-84ab-48af-a9b8-2f972648b474 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:15.823373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 671/1320] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:15.828793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75007-37bb-481d-85c4-47e8de97f2aa None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:15.829241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75007-37bb-481d-85c4-47e8de97f2aa None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:15.829339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75007-37bb-481d-85c4-47e8de97f2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:15.869943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:15.895159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c3b75007-37bb-481d-85c4-47e8de97f2aa None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:15.896392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c3b75007-37bb-481d-85c4-47e8de97f2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:15.993099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 650/1321] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:16.042910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d2fc-84ab-48af-a9b8-2f972648b474 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:16.045258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-06a6d2fc-84ab-48af-a9b8-2f972648b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:16.149149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d2fc-84ab-48af-a9b8-2f972648b474 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:16.222687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:16.223361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:16.223636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:16.223903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:16.225595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:16.233535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:16.333245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:16.334737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb892-4a12-435f-b010-8fb3a1006b28 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:16.353395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 672/1322] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:19.596832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7b53-a04e-4698-b737-a44802b98a26 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:19.597400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7b53-a04e-4698-b737-a44802b98a26 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:19.597508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7b53-a04e-4698-b737-a44802b98a26 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:19.598847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 651/1323] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:19.604097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9f91-3888-46e9-9c13-e6356a06986c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:19.604523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9f91-3888-46e9-9c13-e6356a06986c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:19.604736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9f91-3888-46e9-9c13-e6356a06986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:19.671608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9c1a9f91-3888-46e9-9c13-e6356a06986c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:19.672925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9c1a9f91-3888-46e9-9c13-e6356a06986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:19.733071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:19.771758 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 673/1324] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:19.809368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7b53-a04e-4698-b737-a44802b98a26 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:19.810964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-51ee7b53-a04e-4698-b737-a44802b98a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:19.915487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7b53-a04e-4698-b737-a44802b98a26 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:19.927865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:19.989936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:19.990577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:19.990851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:19.991120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:19.992772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:20.105355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:20.107560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02951ec-1805-408d-a55b-9ed8fcbcf9cb service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:20.127326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 652/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:22.474547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe5e-6801-416e-a7dc-22c83dbfd28a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:22.475116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe5e-6801-416e-a7dc-22c83dbfd28a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:22.475116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe5e-6801-416e-a7dc-22c83dbfd28a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:22.476442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 674/1326] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:22.482550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483f5d3-059e-40c0-ae3f-fb93650dbccd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:22.483134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483f5d3-059e-40c0-ae3f-fb93650dbccd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:22.483134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483f5d3-059e-40c0-ae3f-fb93650dbccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:22.534875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:22.552945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d483f5d3-059e-40c0-ae3f-fb93650dbccd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:22.561964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d483f5d3-059e-40c0-ae3f-fb93650dbccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:22.657375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 653/1327] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:22.693274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9fe5e-6801-416e-a7dc-22c83dbfd28a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:22.694828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f5c9fe5e-6801-416e-a7dc-22c83dbfd28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:22.801465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9fe5e-6801-416e-a7dc-22c83dbfd28a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:22.879377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:22.880028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:22.880346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:22.880624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:22.882275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:22.900553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:22.997909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:22.999374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f868a9-312d-4ba2-abff-a4a0494f799b service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:23.018538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 675/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:25.345396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2275714-ffff-4e79-a103-c1cf7aa72d54 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:25.345972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2275714-ffff-4e79-a103-c1cf7aa72d54 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:25.345972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2275714-ffff-4e79-a103-c1cf7aa72d54 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:25.347386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 654/1329] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:25.352645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085416-7e75-458a-8540-e4bcde043325 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:25.353097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085416-7e75-458a-8540-e4bcde043325 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:25.353219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085416-7e75-458a-8540-e4bcde043325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:25.417721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-51085416-7e75-458a-8540-e4bcde043325 None None] MFA Rules not processed for user `d79d89fc90a74e709dc9387801d50cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:25.419528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-51085416-7e75-458a-8540-e4bcde043325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:25.486076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:25.518577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 676/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:25.556882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2275714-ffff-4e79-a103-c1cf7aa72d54 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:25.558489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a2275714-ffff-4e79-a103-c1cf7aa72d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:25.663621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2275714-ffff-4e79-a103-c1cf7aa72d54 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:25.683119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:25.738819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:25.739464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:25.739746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:25.740020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:25.741676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:25.851678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:25.853145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b309396-c58c-4b40-ba4d-ead05858324f service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:25.872715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 655/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:28.574280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e51700-fcc8-4020-933f-305945625c68 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:28.581055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e51700-fcc8-4020-933f-305945625c68 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:28.581055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e51700-fcc8-4020-933f-305945625c68 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:28.581055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 677/1332] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:28.582543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e874f7-2160-4511-b415-099ad34182cd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:28.582971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e874f7-2160-4511-b415-099ad34182cd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:28.583144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e874f7-2160-4511-b415-099ad34182cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:28.646599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:28.649144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b5e874f7-2160-4511-b415-099ad34182cd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:28.650349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b5e874f7-2160-4511-b415-099ad34182cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:28.746761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 656/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:28.784464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e51700-fcc8-4020-933f-305945625c68 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:28.785983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-01e51700-fcc8-4020-933f-305945625c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:28.900616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e51700-fcc8-4020-933f-305945625c68 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:28.978003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:28.978659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:28.978942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:28.979267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:28.981050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:29.010794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:29.100374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:29.108046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761850e3-0371-4ebd-ab89-603124382d6c service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:29.122269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 678/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:31.411151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735fd9-95f5-4978-bc77-448b5fd1894f None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:31.411736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735fd9-95f5-4978-bc77-448b5fd1894f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:31.411856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735fd9-95f5-4978-bc77-448b5fd1894f None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:31.413228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 657/1335] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:31.418321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7babff-8ae3-47a3-ac4c-6760a1ad6aae None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:31.418985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7babff-8ae3-47a3-ac4c-6760a1ad6aae None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:31.418985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7babff-8ae3-47a3-ac4c-6760a1ad6aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:31.482698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ee7babff-8ae3-47a3-ac4c-6760a1ad6aae None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:31.483883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ee7babff-8ae3-47a3-ac4c-6760a1ad6aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:31.557167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:31.578897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 679/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:31.618387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735fd9-95f5-4978-bc77-448b5fd1894f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:31.619899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-64735fd9-95f5-4978-bc77-448b5fd1894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:31.725655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735fd9-95f5-4978-bc77-448b5fd1894f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:31.754813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:31.800625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:31.801290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:31.801570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:31.801850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:31.803512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:31.915711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:31.917178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e87c-fe7f-4f89-a8d1-7bca4b0da177 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:31.936379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 658/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:34.785686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927c3a9-0d05-49b5-a8b0-c8b5e1758e95 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:34.786261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927c3a9-0d05-49b5-a8b0-c8b5e1758e95 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:34.786261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927c3a9-0d05-49b5-a8b0-c8b5e1758e95 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:34.787647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 680/1338] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:34.792938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f2ac-52ca-44c6-8b26-db17dcdd84a8 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:34.793628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f2ac-52ca-44c6-8b26-db17dcdd84a8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:34.793628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f2ac-52ca-44c6-8b26-db17dcdd84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:34.859573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6952f2ac-52ca-44c6-8b26-db17dcdd84a8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:34.860901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6952f2ac-52ca-44c6-8b26-db17dcdd84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:34.869136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:34.959728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 659/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:34.995818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927c3a9-0d05-49b5-a8b0-c8b5e1758e95 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:34.999782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8927c3a9-0d05-49b5-a8b0-c8b5e1758e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:35.110625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927c3a9-0d05-49b5-a8b0-c8b5e1758e95 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:35.114237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:35.114882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:35.115163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:35.115438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:35.117228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:35.351236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:35.352653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df704-fd6d-459f-9f81-c602c459d10e service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:35.364336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:35.374813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 681/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:39.887645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3334-ab41-424a-9002-5b537339e1df None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:39.888180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3334-ab41-424a-9002-5b537339e1df None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:39.888321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3334-ab41-424a-9002-5b537339e1df None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:39.889588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 660/1341] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:39.895017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5acec8-c376-45ab-be1d-7e0185500e3a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:39.895432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5acec8-c376-45ab-be1d-7e0185500e3a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:39.895574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5acec8-c376-45ab-be1d-7e0185500e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:39.942706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2e5acec8-c376-45ab-be1d-7e0185500e3a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:39.944006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2e5acec8-c376-45ab-be1d-7e0185500e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:40.020470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 682/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:40.059903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f3334-ab41-424a-9002-5b537339e1df None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:40.071800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f3334-ab41-424a-9002-5b537339e1df None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:40.075324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ccabb-6cd3-4216-ace7-f05136458e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:40.075962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccabb-6cd3-4216-ace7-f05136458e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:40.076275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccabb-6cd3-4216-ace7-f05136458e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:40.076557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccabb-6cd3-4216-ace7-f05136458e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:40.085473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ccabb-6cd3-4216-ace7-f05136458e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:40.086916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ccabb-6cd3-4216-ace7-f05136458e4d service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:40.097694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 661/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:43.338937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ea92-f9b1-4f03-adb5-2a2151365e55 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:43.339535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ea92-f9b1-4f03-adb5-2a2151365e55 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:43.339659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ea92-f9b1-4f03-adb5-2a2151365e55 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:43.341256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 683/1344] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:43.346526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779201f8-04e2-4279-bef2-4dea7573455c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:43.346923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779201f8-04e2-4279-bef2-4dea7573455c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:43.347086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779201f8-04e2-4279-bef2-4dea7573455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:43.374378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-779201f8-04e2-4279-bef2-4dea7573455c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:43.375564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-779201f8-04e2-4279-bef2-4dea7573455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:43.383315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 662/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:43.419872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ea92-f9b1-4f03-adb5-2a2151365e55 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:43.430322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ea92-f9b1-4f03-adb5-2a2151365e55 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:43.434500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcdf7f-90bb-4abf-8653-cf628363bd1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:43.435147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcdf7f-90bb-4abf-8653-cf628363bd1d service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:43.435427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcdf7f-90bb-4abf-8653-cf628363bd1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:43.435698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcdf7f-90bb-4abf-8653-cf628363bd1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:43.444786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcdf7f-90bb-4abf-8653-cf628363bd1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:43.446208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcdf7f-90bb-4abf-8653-cf628363bd1d service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:43.456563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 684/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:47.921382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118fb48-29e0-4fc4-9104-eaaee6f6d4cc None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:47.921931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118fb48-29e0-4fc4-9104-eaaee6f6d4cc None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:47.921931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118fb48-29e0-4fc4-9104-eaaee6f6d4cc None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:47.923440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 663/1347] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:47.929092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8720b-e69a-4810-914d-b6a4bea92a66 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:47.930080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8720b-e69a-4810-914d-b6a4bea92a66 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:47.930566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8720b-e69a-4810-914d-b6a4bea92a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:47.953388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1ec8720b-e69a-4810-914d-b6a4bea92a66 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:47.955556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1ec8720b-e69a-4810-914d-b6a4bea92a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:47.964613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 685/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:48.002860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118fb48-29e0-4fc4-9104-eaaee6f6d4cc None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:38:48.005970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5118fb48-29e0-4fc4-9104-eaaee6f6d4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:48.024626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118fb48-29e0-4fc4-9104-eaaee6f6d4cc None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:38:48.029718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945dc2b-784f-434a-a747-28836442d438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:38:48.030379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945dc2b-784f-434a-a747-28836442d438 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:48.030662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945dc2b-784f-434a-a747-28836442d438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:48.030935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945dc2b-784f-434a-a747-28836442d438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:48.044256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945dc2b-784f-434a-a747-28836442d438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:38:48.044256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945dc2b-784f-434a-a747-28836442d438 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:38:48.053915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 664/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:38:53.718658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15eb9-94d2-4509-b644-01f1747aa7c8 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:53.719227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15eb9-94d2-4509-b644-01f1747aa7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:53.719227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15eb9-94d2-4509-b644-01f1747aa7c8 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:53.720636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 686/1350] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:53.726027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cf313-1935-4aa1-88d2-b364ec04e154 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:53.726513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cf313-1935-4aa1-88d2-b364ec04e154 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:53.726781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cf313-1935-4aa1-88d2-b364ec04e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:53.802436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b66cf313-1935-4aa1-88d2-b364ec04e154 None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:53.805450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b66cf313-1935-4aa1-88d2-b364ec04e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:53.853061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:53.884209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 665/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:38:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:57.946141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=56 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:38:58.484773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411443-6205-4ae5-b964-f948a70aeac6 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:58.485194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411443-6205-4ae5-b964-f948a70aeac6 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:58.485315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411443-6205-4ae5-b964-f948a70aeac6 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:58.486848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 687/1352] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:58.491731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2385-a877-4641-adc6-f88edb930456 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:58.492261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2385-a877-4641-adc6-f88edb930456 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:58.492519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2385-a877-4641-adc6-f88edb930456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:58.512230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-a1bf2385-a877-4641-adc6-f88edb930456 None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:58.513551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a1bf2385-a877-4641-adc6-f88edb930456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:38:58.522163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 666/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:38:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:38:59.962002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5b03d-9825-457b-adef-ef5fd9ac0987 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:59.962569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5b03d-9825-457b-adef-ef5fd9ac0987 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:59.962663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5b03d-9825-457b-adef-ef5fd9ac0987 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:59.964425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 688/1354] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:38:59.970192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ae37-fe4d-49a3-936b-cfeda5c8db48 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:38:59.970759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ae37-fe4d-49a3-936b-cfeda5c8db48 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:38:59.970759 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ae37-fe4d-49a3-936b-cfeda5c8db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:38:59.990137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-03c1ae37-fe4d-49a3-936b-cfeda5c8db48 None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:38:59.991374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-03c1ae37-fe4d-49a3-936b-cfeda5c8db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:00.000451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 667/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:38:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:03.813356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84103d9-9008-4a10-b6ed-46b3fa45ea1a None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:03.813356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84103d9-9008-4a10-b6ed-46b3fa45ea1a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:03.813356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84103d9-9008-4a10-b6ed-46b3fa45ea1a None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:03.813356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 689/1356] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:03.815901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5286c-368c-4682-9c5f-468cbb31b36a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:03.816315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5286c-368c-4682-9c5f-468cbb31b36a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:03.816615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5286c-368c-4682-9c5f-468cbb31b36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:03.836397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-07a5286c-368c-4682-9c5f-468cbb31b36a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:03.837708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-07a5286c-368c-4682-9c5f-468cbb31b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:03.846689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 668/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:03.902326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0c97-c049-4628-a989-b40dc7206075 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:03.902777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0c97-c049-4628-a989-b40dc7206075 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:03.902987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0c97-c049-4628-a989-b40dc7206075 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:03.904500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 690/1358] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 8 13:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:03.914679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d74b-eaa1-483b-9927-c90fd11fde5c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:03.915244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d74b-eaa1-483b-9927-c90fd11fde5c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:03.915691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d74b-eaa1-483b-9927-c90fd11fde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:03.972229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ca22d74b-eaa1-483b-9927-c90fd11fde5c None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:03.974604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ca22d74b-eaa1-483b-9927-c90fd11fde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:04.066422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 669/1359] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 8 13:39:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:04.075793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0c97-c049-4628-a989-b40dc7206075 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:04.091631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0c97-c049-4628-a989-b40dc7206075 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:04.098330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2411-e20a-4bc1-87df-fb0be34aec80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:04.099075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2411-e20a-4bc1-87df-fb0be34aec80 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:04.099428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2411-e20a-4bc1-87df-fb0be34aec80 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:04.099773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2411-e20a-4bc1-87df-fb0be34aec80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:04.109591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2411-e20a-4bc1-87df-fb0be34aec80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:04.111308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2411-e20a-4bc1-87df-fb0be34aec80 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:04.122007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 691/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:06.622655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75643105-6041-4909-9efe-4593b39cc9ff None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:06.623153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75643105-6041-4909-9efe-4593b39cc9ff None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:06.623153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75643105-6041-4909-9efe-4593b39cc9ff None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:06.624575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 670/1361] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:06.631422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53b58-7f95-40ed-8f0b-df7c742a0b2c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:06.631945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53b58-7f95-40ed-8f0b-df7c742a0b2c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:06.632033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53b58-7f95-40ed-8f0b-df7c742a0b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:06.652130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d4e53b58-7f95-40ed-8f0b-df7c742a0b2c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:06.653626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d4e53b58-7f95-40ed-8f0b-df7c742a0b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:06.661831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 692/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:06.707180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75643105-6041-4909-9efe-4593b39cc9ff None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:06.723020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75643105-6041-4909-9efe-4593b39cc9ff None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:06.730317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6c340-04cc-4435-a05f-2acdcb94277e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:06.731223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6c340-04cc-4435-a05f-2acdcb94277e service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:06.731681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6c340-04cc-4435-a05f-2acdcb94277e service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:06.732161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6c340-04cc-4435-a05f-2acdcb94277e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:06.742324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6c340-04cc-4435-a05f-2acdcb94277e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:06.744048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6c340-04cc-4435-a05f-2acdcb94277e service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:06.754905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 671/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:09.533678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc662-d3c5-42fe-90db-3b9e84467f39 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:09.533678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc662-d3c5-42fe-90db-3b9e84467f39 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:09.533678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc662-d3c5-42fe-90db-3b9e84467f39 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:09.533678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 693/1364] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:09.534446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6ca7-98b2-4119-8f3a-8bb2d318669d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:09.534446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6ca7-98b2-4119-8f3a-8bb2d318669d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:09.534446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6ca7-98b2-4119-8f3a-8bb2d318669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:09.550827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8eff6ca7-98b2-4119-8f3a-8bb2d318669d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:09.552027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8eff6ca7-98b2-4119-8f3a-8bb2d318669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:09.560029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 672/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:09.605826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be502bca-0f82-44c4-8a3c-069b2d02afcd None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:09.606115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be502bca-0f82-44c4-8a3c-069b2d02afcd None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:09.606392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be502bca-0f82-44c4-8a3c-069b2d02afcd None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:09.607749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 694/1366] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 8 13:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:09.613731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0792-e3de-454e-b7b3-c49a42458d5e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:09.614024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0792-e3de-454e-b7b3-c49a42458d5e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:09.614304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0792-e3de-454e-b7b3-c49a42458d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:09.633454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-542c0792-e3de-454e-b7b3-c49a42458d5e None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:09.634712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-542c0792-e3de-454e-b7b3-c49a42458d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:09.644437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 673/1367] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 8 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:09.658967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be502bca-0f82-44c4-8a3c-069b2d02afcd None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:09.674746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be502bca-0f82-44c4-8a3c-069b2d02afcd None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:09.680295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b4e5-149f-4b53-99d5-93bc4edca17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:09.681078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b4e5-149f-4b53-99d5-93bc4edca17c service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:09.681364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b4e5-149f-4b53-99d5-93bc4edca17c service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:09.681639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b4e5-149f-4b53-99d5-93bc4edca17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:09.690254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9b4e5-149f-4b53-99d5-93bc4edca17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:09.691876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9b4e5-149f-4b53-99d5-93bc4edca17c service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:09.701759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 695/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:12.202695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10948b0-e1b2-487d-a523-02e5e562aabe None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.203233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10948b0-e1b2-487d-a523-02e5e562aabe None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.203233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10948b0-e1b2-487d-a523-02e5e562aabe None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.204634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 674/1369] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:12.210138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.210580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.210663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.223985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d50c-6101-4782-8bbd-bc92bb69a9ed None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.224287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d50c-6101-4782-8bbd-bc92bb69a9ed None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.224576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d50c-6101-4782-8bbd-bc92bb69a9ed None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.225960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 675/1370] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:39:12.229984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:12.231262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:12.231779 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e2c8c-2d86-4127-9624-4b90922a2b3c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.232273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e2c8c-2d86-4127-9624-4b90922a2b3c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.232561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e2c8c-2d86-4127-9624-4b90922a2b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.240666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 696/1371] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:12.254203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8d9e2c8c-2d86-4127-9624-4b90922a2b3c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:12.255404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8d9e2c8c-2d86-4127-9624-4b90922a2b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:12.263983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 676/1372] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:39:12.310483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:12.323571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d8ab-201d-400e-bcfb-b924730bd1da None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:12.329918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c34ca0-d350-4b56-a49b-0424e82dd9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:12.330576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34ca0-d350-4b56-a49b-0424e82dd9da service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.330857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34ca0-d350-4b56-a49b-0424e82dd9da service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.331131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34ca0-d350-4b56-a49b-0424e82dd9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.340593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34ca0-d350-4b56-a49b-0424e82dd9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:12.342179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34ca0-d350-4b56-a49b-0424e82dd9da service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:12.352471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 697/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:12.566188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6be6c-604c-478b-92cd-dca4f90d839b None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.566188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6be6c-604c-478b-92cd-dca4f90d839b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.566188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6be6c-604c-478b-92cd-dca4f90d839b None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.568863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 677/1374] 10.222.0.55 () {54 vars in 963 bytes} [Wed Jun 8 13:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:12.573126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69906e66-3bc4-4389-86ac-4f72d2f56d1d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.573539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69906e66-3bc4-4389-86ac-4f72d2f56d1d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.573955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69906e66-3bc4-4389-86ac-4f72d2f56d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.631793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-69906e66-3bc4-4389-86ac-4f72d2f56d1d None None] MFA Rules not processed for user `0a04840b445544828154575b4ac4a241`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:12.633136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-69906e66-3bc4-4389-86ac-4f72d2f56d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:12.701647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 698/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Wed Jun 8 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:12.710888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6be6c-604c-478b-92cd-dca4f90d839b None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:12.723345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6be6c-604c-478b-92cd-dca4f90d839b None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:12.727000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9893-1ff7-4a6e-b664-5bf878a75d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:12.727744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9893-1ff7-4a6e-b664-5bf878a75d7d service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:12.728151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9893-1ff7-4a6e-b664-5bf878a75d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:12.728523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9893-1ff7-4a6e-b664-5bf878a75d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:12.739415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e9893-1ff7-4a6e-b664-5bf878a75d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:12.741037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e9893-1ff7-4a6e-b664-5bf878a75d7d service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:12.753770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 678/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:39:14.750288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8611a-0e73-4e53-af3a-7cc5d1db239c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:14.750865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8611a-0e73-4e53-af3a-7cc5d1db239c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:14.750865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8611a-0e73-4e53-af3a-7cc5d1db239c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:14.752186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 699/1377] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:14.757952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcf0e-b953-4045-80f7-ae5d0856d31e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:14.758508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcf0e-b953-4045-80f7-ae5d0856d31e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:14.758593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcf0e-b953-4045-80f7-ae5d0856d31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:14.779405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-268dcf0e-b953-4045-80f7-ae5d0856d31e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:14.780695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-268dcf0e-b953-4045-80f7-ae5d0856d31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:14.788873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 679/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:14.834245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8611a-0e73-4e53-af3a-7cc5d1db239c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:14.849996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8611a-0e73-4e53-af3a-7cc5d1db239c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:14.856919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2dcc6-6b5b-4b60-826a-702bb603fa5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:14.857598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2dcc6-6b5b-4b60-826a-702bb603fa5d service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:14.857883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2dcc6-6b5b-4b60-826a-702bb603fa5d service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:14.858193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2dcc6-6b5b-4b60-826a-702bb603fa5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:14.867769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2dcc6-6b5b-4b60-826a-702bb603fa5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:14.869440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2dcc6-6b5b-4b60-826a-702bb603fa5d service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:14.880307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 700/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:17.292843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988699d-50c2-4846-98ca-d67adde6d9de None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:17.293410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988699d-50c2-4846-98ca-d67adde6d9de None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:17.293901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988699d-50c2-4846-98ca-d67adde6d9de None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:17.295558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 680/1380] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:17.300995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c4c5-dfcd-4903-bd2f-0589c826289e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:17.301480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c4c5-dfcd-4903-bd2f-0589c826289e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:17.301566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268c4c5-dfcd-4903-bd2f-0589c826289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:17.321136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0268c4c5-dfcd-4903-bd2f-0589c826289e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:17.322316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0268c4c5-dfcd-4903-bd2f-0589c826289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:17.330947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 701/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:17.374729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988699d-50c2-4846-98ca-d67adde6d9de None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:17.389607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988699d-50c2-4846-98ca-d67adde6d9de None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:17.395167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3933-4941-4f51-9dc8-e2df67b1b723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:17.396041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3933-4941-4f51-9dc8-e2df67b1b723 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:17.396478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3933-4941-4f51-9dc8-e2df67b1b723 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:17.396854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3933-4941-4f51-9dc8-e2df67b1b723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:17.405216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3933-4941-4f51-9dc8-e2df67b1b723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:17.406919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3933-4941-4f51-9dc8-e2df67b1b723 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:17.417329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 681/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:19.879454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4f86-7310-47a8-8bc5-16389ce60a3b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:19.880030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4f86-7310-47a8-8bc5-16389ce60a3b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:19.880030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4f86-7310-47a8-8bc5-16389ce60a3b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:19.881393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 702/1383] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:19.887298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdde50-77ca-4e36-b613-7048924a97af None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:19.887730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdde50-77ca-4e36-b613-7048924a97af None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:19.887834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdde50-77ca-4e36-b613-7048924a97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:19.895136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:19.907903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d1bdde50-77ca-4e36-b613-7048924a97af None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:19.909150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d1bdde50-77ca-4e36-b613-7048924a97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:19.918393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 682/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:19.959324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d4f86-7310-47a8-8bc5-16389ce60a3b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:19.974726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d4f86-7310-47a8-8bc5-16389ce60a3b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:19.981056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910a12e-daf3-47da-a9d1-8656d4e2bb6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:19.981702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910a12e-daf3-47da-a9d1-8656d4e2bb6a service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:19.981984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910a12e-daf3-47da-a9d1-8656d4e2bb6a service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:19.982257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910a12e-daf3-47da-a9d1-8656d4e2bb6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:19.990743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910a12e-daf3-47da-a9d1-8656d4e2bb6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:19.992355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910a12e-daf3-47da-a9d1-8656d4e2bb6a service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:20.002862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 703/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:22.311578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895835-771a-409b-98e9-ffe2eac6a5ea None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:22.312310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895835-771a-409b-98e9-ffe2eac6a5ea None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:22.312310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895835-771a-409b-98e9-ffe2eac6a5ea None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:22.313560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 683/1386] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:22.318937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b39ba2-8849-4829-83f2-815f9f477c49 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:22.319377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b39ba2-8849-4829-83f2-815f9f477c49 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:22.319515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b39ba2-8849-4829-83f2-815f9f477c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:22.337968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-30b39ba2-8849-4829-83f2-815f9f477c49 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:22.339567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-30b39ba2-8849-4829-83f2-815f9f477c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:22.347777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 704/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:22.393405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895835-771a-409b-98e9-ffe2eac6a5ea None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:22.408566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895835-771a-409b-98e9-ffe2eac6a5ea None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:22.414216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d899325-8537-4afd-afc7-4c498d157c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:22.414890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899325-8537-4afd-afc7-4c498d157c05 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:22.415181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899325-8537-4afd-afc7-4c498d157c05 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:22.415469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899325-8537-4afd-afc7-4c498d157c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:22.431565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d899325-8537-4afd-afc7-4c498d157c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:22.433959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d899325-8537-4afd-afc7-4c498d157c05 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:22.444426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 684/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:25.796294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986617ce-dd78-4fb5-991a-8c6b4075d503 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:25.797020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986617ce-dd78-4fb5-991a-8c6b4075d503 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:25.797020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986617ce-dd78-4fb5-991a-8c6b4075d503 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:25.798168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 705/1389] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:25.803473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dbf52-8adf-4bf9-b8cc-bd22f88091ec None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:25.803933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dbf52-8adf-4bf9-b8cc-bd22f88091ec None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:25.804048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dbf52-8adf-4bf9-b8cc-bd22f88091ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:25.821950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6e5dbf52-8adf-4bf9-b8cc-bd22f88091ec None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:25.828785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6e5dbf52-8adf-4bf9-b8cc-bd22f88091ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:25.831718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 685/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:25.877286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986617ce-dd78-4fb5-991a-8c6b4075d503 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:25.896564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986617ce-dd78-4fb5-991a-8c6b4075d503 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:25.904589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abc36-4f76-40a6-8d65-b303db4c664e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:25.905484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abc36-4f76-40a6-8d65-b303db4c664e service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:25.905846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abc36-4f76-40a6-8d65-b303db4c664e service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:25.906187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abc36-4f76-40a6-8d65-b303db4c664e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:25.916738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9abc36-4f76-40a6-8d65-b303db4c664e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:25.919670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9abc36-4f76-40a6-8d65-b303db4c664e service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:25.933225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 706/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:28.439349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7dbbc-4dd9-40e2-9875-cd7516193f20 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:28.439988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7dbbc-4dd9-40e2-9875-cd7516193f20 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:28.439988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7dbbc-4dd9-40e2-9875-cd7516193f20 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:28.441295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 686/1392] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:28.446524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc79e8-3bb6-457c-9ad5-0827d4c07ed0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:28.446961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc79e8-3bb6-457c-9ad5-0827d4c07ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:28.447091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc79e8-3bb6-457c-9ad5-0827d4c07ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:28.453685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=87 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:28.466494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0fbc79e8-3bb6-457c-9ad5-0827d4c07ed0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:28.470751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0fbc79e8-3bb6-457c-9ad5-0827d4c07ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:28.475668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 707/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:28.520481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7dbbc-4dd9-40e2-9875-cd7516193f20 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:28.535237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7dbbc-4dd9-40e2-9875-cd7516193f20 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:28.540792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8724e-164d-4006-8a5b-780ed0034bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:28.541540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8724e-164d-4006-8a5b-780ed0034bc1 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:28.541919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8724e-164d-4006-8a5b-780ed0034bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:28.542201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8724e-164d-4006-8a5b-780ed0034bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:28.550868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8724e-164d-4006-8a5b-780ed0034bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:28.552468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8724e-164d-4006-8a5b-780ed0034bc1 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:28.562366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 687/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:28.985644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5e89f-2486-40c1-95f7-07a2c635ed3b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:28.985933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5e89f-2486-40c1-95f7-07a2c635ed3b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:28.986207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5e89f-2486-40c1-95f7-07a2c635ed3b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:28.987714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 708/1395] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:28.992817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22d11-9e6c-41f9-ab1c-7ac49ba167a1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:28.993121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22d11-9e6c-41f9-ab1c-7ac49ba167a1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:28.993470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22d11-9e6c-41f9-ab1c-7ac49ba167a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:29.011565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-23e22d11-9e6c-41f9-ab1c-7ac49ba167a1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:29.012799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-23e22d11-9e6c-41f9-ab1c-7ac49ba167a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:29.020745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 688/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:29.077763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4587a-c426-4d32-8b9b-7b79903329a3 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:29.078046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4587a-c426-4d32-8b9b-7b79903329a3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:29.078345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4587a-c426-4d32-8b9b-7b79903329a3 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:29.079718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 709/1397] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jun 8 13:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:29.084819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfe106-b6be-4117-813e-fdc68612e10f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:29.085115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfe106-b6be-4117-813e-fdc68612e10f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:29.085397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfe106-b6be-4117-813e-fdc68612e10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:29.138677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9fcfe106-b6be-4117-813e-fdc68612e10f None None] MFA Rules not processed for user `4cbadd181ac245969a762c302998fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:29.139911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9fcfe106-b6be-4117-813e-fdc68612e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:29.199009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 689/1398] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jun 8 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:29.206601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4587a-c426-4d32-8b9b-7b79903329a3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:29.218209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4587a-c426-4d32-8b9b-7b79903329a3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:29.221812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5733c-f9a3-4f3f-9095-b314f8c5d903 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:29.222565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5733c-f9a3-4f3f-9095-b314f8c5d903 service glance] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:29.222909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5733c-f9a3-4f3f-9095-b314f8c5d903 service glance] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:29.223251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5733c-f9a3-4f3f-9095-b314f8c5d903 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:29.233019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5733c-f9a3-4f3f-9095-b314f8c5d903 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:29.234445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5733c-f9a3-4f3f-9095-b314f8c5d903 service glance] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:29.243792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 710/1399] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:29.891141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b68ce-28b1-4379-b310-4528827ae3e0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:29.891624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b68ce-28b1-4379-b310-4528827ae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:29.891726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b68ce-28b1-4379-b310-4528827ae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:29.940876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e17b68ce-28b1-4379-b310-4528827ae3e0 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:29.942120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e17b68ce-28b1-4379-b310-4528827ae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:30.009492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 690/1400] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:30.053359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e945b6-af1f-4b45-ad04-de38c772d06e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:30.053811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e945b6-af1f-4b45-ad04-de38c772d06e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:30.054027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e945b6-af1f-4b45-ad04-de38c772d06e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:30.055525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 711/1401] 10.222.0.55 () {54 vars in 942 bytes} [Wed Jun 8 13:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:30.062321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358fd34-a99b-483f-9020-002484cc6986 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:30.062619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358fd34-a99b-483f-9020-002484cc6986 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:30.063185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358fd34-a99b-483f-9020-002484cc6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:30.074989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:30.113454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-4358fd34-a99b-483f-9020-002484cc6986 None None] MFA Rules not processed for user `a20d31e9b69d4807a3e31f796fca6274`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:30.114662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4358fd34-a99b-483f-9020-002484cc6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:30.188444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 691/1402] 10.222.0.55 () {58 vars in 1039 bytes} [Wed Jun 8 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:30.197830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e945b6-af1f-4b45-ad04-de38c772d06e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:30.211329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e945b6-af1f-4b45-ad04-de38c772d06e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:30.216795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab4ce5-eddf-409c-9c8e-6a5007543a42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:30.217434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab4ce5-eddf-409c-9c8e-6a5007543a42 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:30.217717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab4ce5-eddf-409c-9c8e-6a5007543a42 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:30.218031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab4ce5-eddf-409c-9c8e-6a5007543a42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:30.225909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab4ce5-eddf-409c-9c8e-6a5007543a42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:30.227479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab4ce5-eddf-409c-9c8e-6a5007543a42 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:30.236531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 712/1403] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:39:30.985122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3b9ed-e648-43d5-8dc0-0f854b5da52a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:30.985803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3b9ed-e648-43d5-8dc0-0f854b5da52a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:30.985803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3b9ed-e648-43d5-8dc0-0f854b5da52a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:30.987035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 692/1404] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:30.992309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1c57-fda1-4029-8e31-ae7024763e90 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:30.992701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1c57-fda1-4029-8e31-ae7024763e90 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:30.993052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1c57-fda1-4029-8e31-ae7024763e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:31.012098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7d4a1c57-fda1-4029-8e31-ae7024763e90 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:31.013420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7d4a1c57-fda1-4029-8e31-ae7024763e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:31.022026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 713/1405] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:31.073628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3b9ed-e648-43d5-8dc0-0f854b5da52a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:31.097633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3b9ed-e648-43d5-8dc0-0f854b5da52a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:31.103634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c5bb-240f-434e-87a7-038a997e46e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:31.104368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c5bb-240f-434e-87a7-038a997e46e0 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:31.104778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c5bb-240f-434e-87a7-038a997e46e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:31.105075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c5bb-240f-434e-87a7-038a997e46e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:31.118208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c5bb-240f-434e-87a7-038a997e46e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:31.119866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c5bb-240f-434e-87a7-038a997e46e0 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:31.134543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 693/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:33.626209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4fe0b-557c-42f2-a183-2cfffbcc627c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:33.626777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4fe0b-557c-42f2-a183-2cfffbcc627c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:33.626777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4fe0b-557c-42f2-a183-2cfffbcc627c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:33.628131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 714/1407] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:33.633344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201afce9-913b-4604-a747-25b7f7b0259d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:33.634144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201afce9-913b-4604-a747-25b7f7b0259d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:33.634501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201afce9-913b-4604-a747-25b7f7b0259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:33.653297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-201afce9-913b-4604-a747-25b7f7b0259d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:33.654576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-201afce9-913b-4604-a747-25b7f7b0259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:33.665048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 694/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:33.709730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4fe0b-557c-42f2-a183-2cfffbcc627c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:33.725033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4fe0b-557c-42f2-a183-2cfffbcc627c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:33.732316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f681691-5288-43d1-8fb4-8bf8a70af66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:33.733063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681691-5288-43d1-8fb4-8bf8a70af66d service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:33.733414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681691-5288-43d1-8fb4-8bf8a70af66d service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:33.733748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681691-5288-43d1-8fb4-8bf8a70af66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:33.743413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f681691-5288-43d1-8fb4-8bf8a70af66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:33.745779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f681691-5288-43d1-8fb4-8bf8a70af66d service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:33.763187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 715/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:43.647332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=50 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:43.751164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=23 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:54.440167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e0d76-c384-47ae-b7a6-f2054f5d0dca None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:54.440713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e0d76-c384-47ae-b7a6-f2054f5d0dca None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:54.440713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e0d76-c384-47ae-b7a6-f2054f5d0dca None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:54.442011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 695/1410] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jun 8 13:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:54.447141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f96b-e7bb-49b4-b55c-5912ff01b365 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:54.447568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f96b-e7bb-49b4-b55c-5912ff01b365 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:54.447691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f96b-e7bb-49b4-b55c-5912ff01b365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:54.465782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5635f96b-e7bb-49b4-b55c-5912ff01b365 None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:54.466948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5635f96b-e7bb-49b4-b55c-5912ff01b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:54.475375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 716/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 8 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:54.489440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca576f3e-5f49-430e-9721-85eb0faf8dca None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:54.489728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca576f3e-5f49-430e-9721-85eb0faf8dca None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:54.490005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca576f3e-5f49-430e-9721-85eb0faf8dca None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:54.491356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 696/1412] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jun 8 13:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:54.496629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac8d5-b71b-4f1f-856f-e94fedf37464 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:54.496921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac8d5-b71b-4f1f-856f-e94fedf37464 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:54.497201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac8d5-b71b-4f1f-856f-e94fedf37464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:54.515781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-eb1ac8d5-b71b-4f1f-856f-e94fedf37464 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:54.517000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-eb1ac8d5-b71b-4f1f-856f-e94fedf37464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:54.525956 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 717/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 8 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:57.433387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e825d-d89e-4cd3-99f0-5ccd6baf5508 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:57.433969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e825d-d89e-4cd3-99f0-5ccd6baf5508 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:57.433969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e825d-d89e-4cd3-99f0-5ccd6baf5508 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:57.435294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:57.440726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd386-a176-4e75-b681-15aa8f21c73a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:57.441180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd386-a176-4e75-b681-15aa8f21c73a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:57.441281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd386-a176-4e75-b681-15aa8f21c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:57.461426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a92bd386-a176-4e75-b681-15aa8f21c73a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:57.462624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a92bd386-a176-4e75-b681-15aa8f21c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:57.471464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:57.515423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e825d-d89e-4cd3-99f0-5ccd6baf5508 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:57.530144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e825d-d89e-4cd3-99f0-5ccd6baf5508 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:57.535912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608076f-94f7-4ab7-9452-be36b3ee9f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:57.536617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608076f-94f7-4ab7-9452-be36b3ee9f37 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:57.536903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608076f-94f7-4ab7-9452-be36b3ee9f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:57.537181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608076f-94f7-4ab7-9452-be36b3ee9f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:57.546565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608076f-94f7-4ab7-9452-be36b3ee9f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:57.548176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608076f-94f7-4ab7-9452-be36b3ee9f37 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:57.557920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 698/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:58.541191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457fa70-a977-48d5-baeb-b6cf7058cf07 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:58.541715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457fa70-a977-48d5-baeb-b6cf7058cf07 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:58.541715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457fa70-a977-48d5-baeb-b6cf7058cf07 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:58.543245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:58.548225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b5f7f-26e7-4cd6-86ac-49c22737f19a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:58.548634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b5f7f-26e7-4cd6-86ac-49c22737f19a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:58.548780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b5f7f-26e7-4cd6-86ac-49c22737f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:58.566465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-735b5f7f-26e7-4cd6-86ac-49c22737f19a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:58.567668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-735b5f7f-26e7-4cd6-86ac-49c22737f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:58.577821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:58.756572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457fa70-a977-48d5-baeb-b6cf7058cf07 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:58.770902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457fa70-a977-48d5-baeb-b6cf7058cf07 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:58.776191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2c81-cc08-4e7e-9de1-8ea468787b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:58.777502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2c81-cc08-4e7e-9de1-8ea468787b1a service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:58.777809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2c81-cc08-4e7e-9de1-8ea468787b1a service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:58.778078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2c81-cc08-4e7e-9de1-8ea468787b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:58.786101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2c81-cc08-4e7e-9de1-8ea468787b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:58.787658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2c81-cc08-4e7e-9de1-8ea468787b1a service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:58.797114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 720/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:59.743862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a209272-53e2-4a82-bc29-f12ed04693ff None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:59.744406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a209272-53e2-4a82-bc29-f12ed04693ff None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:59.744524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a209272-53e2-4a82-bc29-f12ed04693ff None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:59.746771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:39:59.751813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b827-f5bd-4c43-8e56-491d8c60660f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:59.752256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b827-f5bd-4c43-8e56-491d8c60660f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:59.752401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b827-f5bd-4c43-8e56-491d8c60660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:59.770685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2891b827-f5bd-4c43-8e56-491d8c60660f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:39:59.771886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2891b827-f5bd-4c43-8e56-491d8c60660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:39:59.779877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:39:59.929467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a209272-53e2-4a82-bc29-f12ed04693ff None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:39:59.944460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a209272-53e2-4a82-bc29-f12ed04693ff None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:39:59.950300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac1c4-f330-460e-a8b9-99a3665410f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:39:59.950931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac1c4-f330-460e-a8b9-99a3665410f0 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:39:59.951316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac1c4-f330-460e-a8b9-99a3665410f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:39:59.951595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac1c4-f330-460e-a8b9-99a3665410f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:39:59.959781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac1c4-f330-460e-a8b9-99a3665410f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:39:59.961429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac1c4-f330-460e-a8b9-99a3665410f0 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:39:59.970993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 701/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:00.874426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6576b1-daf1-4137-9691-ca9a2f8b94fb None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:00.874911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6576b1-daf1-4137-9691-ca9a2f8b94fb None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:00.875023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6576b1-daf1-4137-9691-ca9a2f8b94fb None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:00.876396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:00.881480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea99910-3d62-4725-b12d-63e28b27d4f7 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:00.881886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea99910-3d62-4725-b12d-63e28b27d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:00.882042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea99910-3d62-4725-b12d-63e28b27d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:00.900882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1ea99910-3d62-4725-b12d-63e28b27d4f7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:00.902631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1ea99910-3d62-4725-b12d-63e28b27d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:00.910248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:01.058623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6576b1-daf1-4137-9691-ca9a2f8b94fb None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:01.072504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6576b1-daf1-4137-9691-ca9a2f8b94fb None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:01.078319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2447-f25e-4fa9-b843-2586400ac5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:01.078944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2447-f25e-4fa9-b843-2586400ac5a8 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:01.079221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2447-f25e-4fa9-b843-2586400ac5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:01.079494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2447-f25e-4fa9-b843-2586400ac5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:01.087388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2447-f25e-4fa9-b843-2586400ac5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:01.089568 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2447-f25e-4fa9-b843-2586400ac5a8 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:01.099688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 723/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:02.012991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c15c4-43b0-4d70-ad7b-7fdc758617cf None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:02.017080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c15c4-43b0-4d70-ad7b-7fdc758617cf None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:02.017368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c15c4-43b0-4d70-ad7b-7fdc758617cf None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:02.018743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:40:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:02.025098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b113-8415-457d-a65d-445cf0448cda None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:02.025547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b113-8415-457d-a65d-445cf0448cda None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:02.025645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b113-8415-457d-a65d-445cf0448cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:02.043743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-81a9b113-8415-457d-a65d-445cf0448cda None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:02.044980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-81a9b113-8415-457d-a65d-445cf0448cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:02.052763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:02.203115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c15c4-43b0-4d70-ad7b-7fdc758617cf None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:02.217701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c15c4-43b0-4d70-ad7b-7fdc758617cf None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:02.222940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c307-f02e-48a2-948a-85f2b527ee3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:02.223574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c307-f02e-48a2-948a-85f2b527ee3c service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:02.223853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c307-f02e-48a2-948a-85f2b527ee3c service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:02.224166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c307-f02e-48a2-948a-85f2b527ee3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:02.232246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482c307-f02e-48a2-948a-85f2b527ee3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:02.233801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482c307-f02e-48a2-948a-85f2b527ee3c service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:02.243011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 704/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:03.203246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4034-945b-4533-ac6a-1d9e8389b028 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:03.203801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4034-945b-4533-ac6a-1d9e8389b028 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:03.203801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4034-945b-4533-ac6a-1d9e8389b028 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:03.205197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:03.210198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c9cef-5fb2-4b72-b41b-1ef7cffb8e4d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:03.210725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c9cef-5fb2-4b72-b41b-1ef7cffb8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:03.210806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c9cef-5fb2-4b72-b41b-1ef7cffb8e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:03.229946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-746c9cef-5fb2-4b72-b41b-1ef7cffb8e4d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:03.231142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-746c9cef-5fb2-4b72-b41b-1ef7cffb8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:03.238913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:03.393855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba4034-945b-4533-ac6a-1d9e8389b028 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:03.408581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba4034-945b-4533-ac6a-1d9e8389b028 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:03.413881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b7eaf-de09-4930-b6d5-6175fad6c99a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:03.414520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7eaf-de09-4930-b6d5-6175fad6c99a service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:03.414800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7eaf-de09-4930-b6d5-6175fad6c99a service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:03.415075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7eaf-de09-4930-b6d5-6175fad6c99a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:03.423668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7eaf-de09-4930-b6d5-6175fad6c99a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:03.425285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7eaf-de09-4930-b6d5-6175fad6c99a service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:03.434487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 726/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:04.351568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7d6f6-0147-40f0-805b-4048bec4147a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:04.352151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7d6f6-0147-40f0-805b-4048bec4147a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:04.352151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7d6f6-0147-40f0-805b-4048bec4147a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:04.353501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:04.360176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732e686-c7b2-44ed-9d5d-9dd7278199e7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:04.360604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732e686-c7b2-44ed-9d5d-9dd7278199e7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:04.360732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732e686-c7b2-44ed-9d5d-9dd7278199e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:04.379052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9732e686-c7b2-44ed-9d5d-9dd7278199e7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:04.380278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9732e686-c7b2-44ed-9d5d-9dd7278199e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:04.388949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:04.534909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7d6f6-0147-40f0-805b-4048bec4147a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:04.549452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7d6f6-0147-40f0-805b-4048bec4147a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:04.554679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada91fcc-b3b5-42fe-b89f-826992db1c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:04.555332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91fcc-b3b5-42fe-b89f-826992db1c4f service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:04.555610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91fcc-b3b5-42fe-b89f-826992db1c4f service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:04.555881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91fcc-b3b5-42fe-b89f-826992db1c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:04.564518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91fcc-b3b5-42fe-b89f-826992db1c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:04.566061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91fcc-b3b5-42fe-b89f-826992db1c4f service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:04.575257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 707/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:05.495752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3662-6398-457e-bc71-9975ce9f986c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:05.496330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3662-6398-457e-bc71-9975ce9f986c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:05.496330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3662-6398-457e-bc71-9975ce9f986c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:05.497696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:05.503157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd111-26ea-4606-aa7c-1b4de29d7a3b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:05.503601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd111-26ea-4606-aa7c-1b4de29d7a3b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:05.503698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd111-26ea-4606-aa7c-1b4de29d7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:05.522502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9eacd111-26ea-4606-aa7c-1b4de29d7a3b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:05.523697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9eacd111-26ea-4606-aa7c-1b4de29d7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:05.532406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:05.681955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3662-6398-457e-bc71-9975ce9f986c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:05.697467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3662-6398-457e-bc71-9975ce9f986c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:05.703813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab704e6-374e-430c-864e-60012389e545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:05.704492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab704e6-374e-430c-864e-60012389e545 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:05.704778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab704e6-374e-430c-864e-60012389e545 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:05.705055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab704e6-374e-430c-864e-60012389e545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:05.713327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab704e6-374e-430c-864e-60012389e545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:05.715029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab704e6-374e-430c-864e-60012389e545 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:05.724593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 729/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:06.617662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364b359-65e1-4c7d-98f9-75af020f3023 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:06.618184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364b359-65e1-4c7d-98f9-75af020f3023 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:06.618184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364b359-65e1-4c7d-98f9-75af020f3023 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:06.619579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:06.625284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73589436-c680-4b2f-985b-b875e7c7f810 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:06.625685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73589436-c680-4b2f-985b-b875e7c7f810 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:06.625863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73589436-c680-4b2f-985b-b875e7c7f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:06.644263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-73589436-c680-4b2f-985b-b875e7c7f810 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:06.645435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-73589436-c680-4b2f-985b-b875e7c7f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:06.653084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:06.807472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364b359-65e1-4c7d-98f9-75af020f3023 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:06.822789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364b359-65e1-4c7d-98f9-75af020f3023 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:06.828569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1bd9b-42d3-4e3f-bc85-9cb1943b5d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:06.829206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bd9b-42d3-4e3f-bc85-9cb1943b5d22 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:06.829489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bd9b-42d3-4e3f-bc85-9cb1943b5d22 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:06.829766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bd9b-42d3-4e3f-bc85-9cb1943b5d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:06.838172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1bd9b-42d3-4e3f-bc85-9cb1943b5d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:06.841866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1bd9b-42d3-4e3f-bc85-9cb1943b5d22 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:06.849974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 710/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:08.980552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f779-6eee-424f-ab0a-1752f2da960c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:08.981115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f779-6eee-424f-ab0a-1752f2da960c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:08.981115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f779-6eee-424f-ab0a-1752f2da960c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:08.982469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:08.988021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb8c6-6953-4f01-9570-7fa2917c38fc None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:08.988507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb8c6-6953-4f01-9570-7fa2917c38fc None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:08.988615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb8c6-6953-4f01-9570-7fa2917c38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:09.007578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5e7bb8c6-6953-4f01-9570-7fa2917c38fc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:09.008798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e7bb8c6-6953-4f01-9570-7fa2917c38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:09.023985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:09.074949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454f779-6eee-424f-ab0a-1752f2da960c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:09.085498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454f779-6eee-424f-ab0a-1752f2da960c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:09.089008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8962ec-3927-488c-910f-092c98ccd14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:09.089731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8962ec-3927-488c-910f-092c98ccd14b service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:09.090013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8962ec-3927-488c-910f-092c98ccd14b service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:09.090284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8962ec-3927-488c-910f-092c98ccd14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:09.099770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8962ec-3927-488c-910f-092c98ccd14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:09.101230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8962ec-3927-488c-910f-092c98ccd14b service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:09.111175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 732/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:40:11.565492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ededa5-2626-4c62-bff7-c4bab8ebaf1e None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:11.566040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ededa5-2626-4c62-bff7-c4bab8ebaf1e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:11.566040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ededa5-2626-4c62-bff7-c4bab8ebaf1e None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:11.567410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:11.572836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f356e8-821e-43ed-a06d-e875da05d42c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:11.573296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f356e8-821e-43ed-a06d-e875da05d42c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:11.573442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f356e8-821e-43ed-a06d-e875da05d42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:11.590701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-b3f356e8-821e-43ed-a06d-e875da05d42c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:11.592183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b3f356e8-821e-43ed-a06d-e875da05d42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:11.599933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:11.639326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ededa5-2626-4c62-bff7-c4bab8ebaf1e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:11.650005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ededa5-2626-4c62-bff7-c4bab8ebaf1e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:11.653968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39742-bdca-457d-882a-00917dc0647c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:11.654593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39742-bdca-457d-882a-00917dc0647c service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:11.654872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39742-bdca-457d-882a-00917dc0647c service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:11.655144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39742-bdca-457d-882a-00917dc0647c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:11.663778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39742-bdca-457d-882a-00917dc0647c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:11.665223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39742-bdca-457d-882a-00917dc0647c service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:11.674960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 713/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:14.307809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479129-f5c7-4716-bfc1-d8fb4a1bdf9e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:14.308515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479129-f5c7-4716-bfc1-d8fb4a1bdf9e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:14.308515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479129-f5c7-4716-bfc1-d8fb4a1bdf9e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:14.309762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:14.314998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941008d2-d1d6-4774-83c1-9e0dd7d8a902 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:14.315445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941008d2-d1d6-4774-83c1-9e0dd7d8a902 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:14.315551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941008d2-d1d6-4774-83c1-9e0dd7d8a902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:14.333868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-941008d2-d1d6-4774-83c1-9e0dd7d8a902 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:14.335128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-941008d2-d1d6-4774-83c1-9e0dd7d8a902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:14.343675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:14.381767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479129-f5c7-4716-bfc1-d8fb4a1bdf9e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:14.392871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479129-f5c7-4716-bfc1-d8fb4a1bdf9e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:14.396301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b903027-cb24-4130-8c49-2b7c217efe72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:14.396933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b903027-cb24-4130-8c49-2b7c217efe72 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:14.397213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b903027-cb24-4130-8c49-2b7c217efe72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:14.397486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b903027-cb24-4130-8c49-2b7c217efe72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:14.406997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b903027-cb24-4130-8c49-2b7c217efe72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:14.408468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b903027-cb24-4130-8c49-2b7c217efe72 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:14.417758 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 735/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:16.800956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa647f-9733-4882-ac34-58150b956200 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:16.801568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa647f-9733-4882-ac34-58150b956200 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:16.801568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa647f-9733-4882-ac34-58150b956200 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:16.802883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:16.808131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a45e-83d9-4f48-9a1f-d1680911d7a8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:16.808597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a45e-83d9-4f48-9a1f-d1680911d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:16.808706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a45e-83d9-4f48-9a1f-d1680911d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:16.826975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-cb55a45e-83d9-4f48-9a1f-d1680911d7a8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:16.828187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-cb55a45e-83d9-4f48-9a1f-d1680911d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:16.835796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:16.875943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa647f-9733-4882-ac34-58150b956200 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:16.887139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa647f-9733-4882-ac34-58150b956200 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:16.890606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824ea8d-c7ca-43bc-9300-60b7d0d2ef6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:16.891232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824ea8d-c7ca-43bc-9300-60b7d0d2ef6c service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:16.891517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824ea8d-c7ca-43bc-9300-60b7d0d2ef6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:16.891790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824ea8d-c7ca-43bc-9300-60b7d0d2ef6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:16.900574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824ea8d-c7ca-43bc-9300-60b7d0d2ef6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:16.902127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824ea8d-c7ca-43bc-9300-60b7d0d2ef6c service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:16.911286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 716/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:19.327860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd2d5-fc58-4e74-a2db-643956941ee0 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:19.328479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd2d5-fc58-4e74-a2db-643956941ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:19.328479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fd2d5-fc58-4e74-a2db-643956941ee0 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:19.329835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:19.335167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489225-f350-4438-b713-ccdcb15e637d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:19.335610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489225-f350-4438-b713-ccdcb15e637d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:19.335722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489225-f350-4438-b713-ccdcb15e637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:19.354141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ee489225-f350-4438-b713-ccdcb15e637d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:19.355349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ee489225-f350-4438-b713-ccdcb15e637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:19.363195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:40:19.402442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd2d5-fc58-4e74-a2db-643956941ee0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:19.413029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fd2d5-fc58-4e74-a2db-643956941ee0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:19.416538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e8640-d5c2-4870-9e32-d33aa84f7c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:19.417461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8640-d5c2-4870-9e32-d33aa84f7c90 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:19.417746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8640-d5c2-4870-9e32-d33aa84f7c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:19.418022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8640-d5c2-4870-9e32-d33aa84f7c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:19.426854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e8640-d5c2-4870-9e32-d33aa84f7c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:19.428308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e8640-d5c2-4870-9e32-d33aa84f7c90 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:19.438433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 738/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:21.755998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078b10f-e383-4bd0-8738-e8d16a025d11 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:21.756570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078b10f-e383-4bd0-8738-e8d16a025d11 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:21.756570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078b10f-e383-4bd0-8738-e8d16a025d11 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:21.757929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:21.763961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3b63-3212-48df-8b19-9b769ddddd3b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:21.764420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3b63-3212-48df-8b19-9b769ddddd3b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:21.764530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3b63-3212-48df-8b19-9b769ddddd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:21.783031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1f8b3b63-3212-48df-8b19-9b769ddddd3b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:21.784253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1f8b3b63-3212-48df-8b19-9b769ddddd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:21.792266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:21.830086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078b10f-e383-4bd0-8738-e8d16a025d11 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:21.841939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078b10f-e383-4bd0-8738-e8d16a025d11 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:21.845393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d23367-87b1-43aa-8142-bdc1f20e1e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:21.846020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23367-87b1-43aa-8142-bdc1f20e1e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:21.846298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23367-87b1-43aa-8142-bdc1f20e1e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:21.846573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23367-87b1-43aa-8142-bdc1f20e1e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:21.856168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d23367-87b1-43aa-8142-bdc1f20e1e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:21.857595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d23367-87b1-43aa-8142-bdc1f20e1e3b service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:21.867081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 719/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:24.142610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc1cf-a87a-48b3-afbf-752586507644 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:24.143144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc1cf-a87a-48b3-afbf-752586507644 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:24.143144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc1cf-a87a-48b3-afbf-752586507644 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:24.144587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:24.149818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4483d-1d15-4655-8f4b-a85c8039e3be None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:24.150316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4483d-1d15-4655-8f4b-a85c8039e3be None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:24.150418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4483d-1d15-4655-8f4b-a85c8039e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:24.156442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=70 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:40:24.168715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d6e4483d-1d15-4655-8f4b-a85c8039e3be None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:24.170478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d6e4483d-1d15-4655-8f4b-a85c8039e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:24.178459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:24.217704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc1cf-a87a-48b3-afbf-752586507644 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:24.223156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=73 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:40:24.228990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc1cf-a87a-48b3-afbf-752586507644 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:24.232800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074abd55-4bc5-4546-859b-e51fc5ba70eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:24.233437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074abd55-4bc5-4546-859b-e51fc5ba70eb service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:24.233840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074abd55-4bc5-4546-859b-e51fc5ba70eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:24.234116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074abd55-4bc5-4546-859b-e51fc5ba70eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:24.242984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074abd55-4bc5-4546-859b-e51fc5ba70eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:24.249644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074abd55-4bc5-4546-859b-e51fc5ba70eb service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:24.254094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 741/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:26.607935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e26fc-5177-44fb-9578-71ce0d529c7c None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:26.608512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e26fc-5177-44fb-9578-71ce0d529c7c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:26.608512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e26fc-5177-44fb-9578-71ce0d529c7c None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:26.609907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:26.615361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39805ad-2946-4536-82fc-5527df861c25 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:26.615805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39805ad-2946-4536-82fc-5527df861c25 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:26.615911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39805ad-2946-4536-82fc-5527df861c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:26.633999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a39805ad-2946-4536-82fc-5527df861c25 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:26.635215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a39805ad-2946-4536-82fc-5527df861c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:26.642936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:26.680940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e26fc-5177-44fb-9578-71ce0d529c7c None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:26.691681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e26fc-5177-44fb-9578-71ce0d529c7c None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:26.695229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea8d51-851a-4479-823e-a39794a55908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:26.695860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea8d51-851a-4479-823e-a39794a55908 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:26.696176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea8d51-851a-4479-823e-a39794a55908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:26.696456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea8d51-851a-4479-823e-a39794a55908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:26.705415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea8d51-851a-4479-823e-a39794a55908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:26.706827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea8d51-851a-4479-823e-a39794a55908 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:26.717306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 722/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:28.970419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86972f2-68d0-415a-859a-beb8bc064fc7 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:28.970984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86972f2-68d0-415a-859a-beb8bc064fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:28.970984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86972f2-68d0-415a-859a-beb8bc064fc7 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:28.972363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:28.977775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879d30-82e9-49e4-a218-7ac0486266f1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:28.978204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879d30-82e9-49e4-a218-7ac0486266f1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:28.978338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879d30-82e9-49e4-a218-7ac0486266f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:28.996306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-54879d30-82e9-49e4-a218-7ac0486266f1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:28.997489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-54879d30-82e9-49e4-a218-7ac0486266f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:29.005181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:29.041025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86972f2-68d0-415a-859a-beb8bc064fc7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:29.052502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86972f2-68d0-415a-859a-beb8bc064fc7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:29.055900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c54493-006d-415f-9ab1-0478c187424c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:29.056556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c54493-006d-415f-9ab1-0478c187424c service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:29.056834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c54493-006d-415f-9ab1-0478c187424c service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:29.057144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c54493-006d-415f-9ab1-0478c187424c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:29.066303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c54493-006d-415f-9ab1-0478c187424c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:29.067739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c54493-006d-415f-9ab1-0478c187424c service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:29.077124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 744/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:31.337833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441ca75-18a7-4359-a3a0-4878a43d675d None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:31.338988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441ca75-18a7-4359-a3a0-4878a43d675d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:31.338988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441ca75-18a7-4359-a3a0-4878a43d675d None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:31.340477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:40:31.345952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225cb16-a1a2-4c6d-af1f-b7a411d92ab4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:31.346398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225cb16-a1a2-4c6d-af1f-b7a411d92ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:31.346495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225cb16-a1a2-4c6d-af1f-b7a411d92ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:31.365215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6225cb16-a1a2-4c6d-af1f-b7a411d92ab4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:40:31.366393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6225cb16-a1a2-4c6d-af1f-b7a411d92ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:40:31.374206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:40:31.411906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441ca75-18a7-4359-a3a0-4878a43d675d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:40:31.423325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441ca75-18a7-4359-a3a0-4878a43d675d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:40:31.426794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af99e9f-9e81-404d-81e5-fc36c4ac3f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:40:31.427447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af99e9f-9e81-404d-81e5-fc36c4ac3f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:40:31.427727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af99e9f-9e81-404d-81e5-fc36c4ac3f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:40:31.428000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af99e9f-9e81-404d-81e5-fc36c4ac3f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:40:31.436900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af99e9f-9e81-404d-81e5-fc36c4ac3f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:40:31.438299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af99e9f-9e81-404d-81e5-fc36c4ac3f2a service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:40:31.447561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 725/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:41.360023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=17 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:40:41.443426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=17 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:41:04.004214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fb476-d022-4ab7-8df9-b0f1071ec9ce None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:04.004781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fb476-d022-4ab7-8df9-b0f1071ec9ce None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:04.004781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fb476-d022-4ab7-8df9-b0f1071ec9ce None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:04.006039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 746/1471] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:04.011942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a82088-1a4d-40d3-9270-5ca99f190b1a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:04.012425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a82088-1a4d-40d3-9270-5ca99f190b1a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:04.012598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a82088-1a4d-40d3-9270-5ca99f190b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:04.030830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-23a82088-1a4d-40d3-9270-5ca99f190b1a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:04.032092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-23a82088-1a4d-40d3-9270-5ca99f190b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:04.040030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 726/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:04.089862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f355b-ebac-4fd3-8085-a8dc5c533200 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:04.090231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f355b-ebac-4fd3-8085-a8dc5c533200 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:04.090518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f355b-ebac-4fd3-8085-a8dc5c533200 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:04.092250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 747/1473] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jun 8 13:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:04.097612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d98adf-c3b6-4743-9d4c-0a64fc3eb28c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:04.097899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d98adf-c3b6-4743-9d4c-0a64fc3eb28c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:04.098180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d98adf-c3b6-4743-9d4c-0a64fc3eb28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:04.116566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b6d98adf-c3b6-4743-9d4c-0a64fc3eb28c None None] MFA Rules not processed for user `4cbadd181ac245969a762c302998fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:04.117721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b6d98adf-c3b6-4743-9d4c-0a64fc3eb28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:04.124742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 727/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jun 8 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:41:04.131986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f355b-ebac-4fd3-8085-a8dc5c533200 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:04.143073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f355b-ebac-4fd3-8085-a8dc5c533200 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:04.147707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6247e7-2dac-43ac-9d1c-830309ef4814 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:04.147707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6247e7-2dac-43ac-9d1c-830309ef4814 service glance] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:04.147707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6247e7-2dac-43ac-9d1c-830309ef4814 service glance] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:04.147707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6247e7-2dac-43ac-9d1c-830309ef4814 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:04.156530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6247e7-2dac-43ac-9d1c-830309ef4814 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:04.157943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6247e7-2dac-43ac-9d1c-830309ef4814 service glance] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:04.167114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 748/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:41:06.533252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad7f8-cfdc-480d-a5ad-640563db7aa1 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:06.533809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad7f8-cfdc-480d-a5ad-640563db7aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:06.533809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad7f8-cfdc-480d-a5ad-640563db7aa1 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:06.535155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 728/1476] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:06.540743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fdb93-f512-4ddb-af4a-2c38d3a0eed2 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:06.541250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fdb93-f512-4ddb-af4a-2c38d3a0eed2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:06.542132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fdb93-f512-4ddb-af4a-2c38d3a0eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:06.560466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f25fdb93-f512-4ddb-af4a-2c38d3a0eed2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:06.564937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f25fdb93-f512-4ddb-af4a-2c38d3a0eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:06.569633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 749/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:06.594066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad7f8-cfdc-480d-a5ad-640563db7aa1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:06.607519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad7f8-cfdc-480d-a5ad-640563db7aa1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:06.612043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:06.612715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:06.612998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:06.613273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:06.613998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:06.615851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:41:06.615851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:41:06.615851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:41:06.617006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80679a9-1d03-4b93-9e70-07827bc24ecf admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:06.637112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 729/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 8 13:41:06 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:41:08.928735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeae81-1b66-4f25-817e-a6cfeec1a383 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:08.929269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeae81-1b66-4f25-817e-a6cfeec1a383 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:08.929269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeae81-1b66-4f25-817e-a6cfeec1a383 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:08.930667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 750/1479] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:08.936137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0e70-f727-4fe2-aeab-4a990d4c0f4a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:08.936526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0e70-f727-4fe2-aeab-4a990d4c0f4a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:08.936706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad0e70-f727-4fe2-aeab-4a990d4c0f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:08.954348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7aad0e70-f727-4fe2-aeab-4a990d4c0f4a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:08.955549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7aad0e70-f727-4fe2-aeab-4a990d4c0f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:08.964447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 730/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:09.007697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeae81-1b66-4f25-817e-a6cfeec1a383 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:09.022403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeae81-1b66-4f25-817e-a6cfeec1a383 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:09.028405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1d59-0744-45d4-87d0-3e2b475c5c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:09.029034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1d59-0744-45d4-87d0-3e2b475c5c8c service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:09.029309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1d59-0744-45d4-87d0-3e2b475c5c8c service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:09.029578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1d59-0744-45d4-87d0-3e2b475c5c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:09.037605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1d59-0744-45d4-87d0-3e2b475c5c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:09.039167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1d59-0744-45d4-87d0-3e2b475c5c8c service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:09.048923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 751/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:41:11.456173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401a88-8226-408f-8439-46ba766b6b78 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:11.456753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401a88-8226-408f-8439-46ba766b6b78 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:11.456753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401a88-8226-408f-8439-46ba766b6b78 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:11.458093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 731/1482] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:11.463242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0e8a-a007-404b-b1c3-16424f0aadb3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:11.463702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0e8a-a007-404b-b1c3-16424f0aadb3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:11.463890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0e8a-a007-404b-b1c3-16424f0aadb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:11.481856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-aa7e0e8a-a007-404b-b1c3-16424f0aadb3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:11.483053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-aa7e0e8a-a007-404b-b1c3-16424f0aadb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:11.490670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 752/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:11.526974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401a88-8226-408f-8439-46ba766b6b78 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:11.537468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401a88-8226-408f-8439-46ba766b6b78 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:11.541890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4522-4434-4c2e-92c8-5e50f6f849f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:11.542529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4522-4434-4c2e-92c8-5e50f6f849f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:11.542811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4522-4434-4c2e-92c8-5e50f6f849f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:11.543086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4522-4434-4c2e-92c8-5e50f6f849f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:11.552227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4522-4434-4c2e-92c8-5e50f6f849f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:11.553656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4522-4434-4c2e-92c8-5e50f6f849f4 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:11.563636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 732/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:41:13.848612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663bbc0-d715-40f6-b555-9f1fdcda724e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:13.849202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663bbc0-d715-40f6-b555-9f1fdcda724e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:13.849202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663bbc0-d715-40f6-b555-9f1fdcda724e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:13.850575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 753/1485] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:13.856387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714e84-73b2-42e8-8660-d097455ea827 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:13.856866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714e84-73b2-42e8-8660-d097455ea827 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:13.856960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714e84-73b2-42e8-8660-d097455ea827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:13.875297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e7714e84-73b2-42e8-8660-d097455ea827 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:13.876518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e7714e84-73b2-42e8-8660-d097455ea827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:13.884496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 733/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:13.922760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663bbc0-d715-40f6-b555-9f1fdcda724e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:13.934000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663bbc0-d715-40f6-b555-9f1fdcda724e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:13.937582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed858379-c153-47c6-b28e-14a7f62d9fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:13.938220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858379-c153-47c6-b28e-14a7f62d9fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:13.938500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858379-c153-47c6-b28e-14a7f62d9fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:13.938770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858379-c153-47c6-b28e-14a7f62d9fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:13.948010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed858379-c153-47c6-b28e-14a7f62d9fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:13.949820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed858379-c153-47c6-b28e-14a7f62d9fbf service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:13.958741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 754/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:41:16.503346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc7f43-6c73-4e93-95bc-bb1275da0ecd None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:16.503920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc7f43-6c73-4e93-95bc-bb1275da0ecd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:16.503920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc7f43-6c73-4e93-95bc-bb1275da0ecd None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:16.505226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 734/1488] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:16.511377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4157-e810-4c9f-8100-8394a56e9200 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:16.511828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4157-e810-4c9f-8100-8394a56e9200 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:16.511931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4157-e810-4c9f-8100-8394a56e9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:16.530081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-310f4157-e810-4c9f-8100-8394a56e9200 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:16.531276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-310f4157-e810-4c9f-8100-8394a56e9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:16.539015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 755/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:16.579831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc7f43-6c73-4e93-95bc-bb1275da0ecd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:16.591430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc7f43-6c73-4e93-95bc-bb1275da0ecd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:16.595186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aaa3b-7183-4d94-bec0-3a49a81c24aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:16.595820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aaa3b-7183-4d94-bec0-3a49a81c24aa service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:16.596132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aaa3b-7183-4d94-bec0-3a49a81c24aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:16.596414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aaa3b-7183-4d94-bec0-3a49a81c24aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:16.605302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aaa3b-7183-4d94-bec0-3a49a81c24aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:16.606710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aaa3b-7183-4d94-bec0-3a49a81c24aa service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:16.615988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 735/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:41:19.212871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bc0d0-e6fb-4869-a760-b578e5247c78 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:19.213631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bc0d0-e6fb-4869-a760-b578e5247c78 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:19.213631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bc0d0-e6fb-4869-a760-b578e5247c78 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:19.214971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 756/1491] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 8 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:41:19.220621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36d50-0ead-4c24-9176-640772cf55a6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:19.221048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36d50-0ead-4c24-9176-640772cf55a6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:19.221173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36d50-0ead-4c24-9176-640772cf55a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:19.238589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-93c36d50-0ead-4c24-9176-640772cf55a6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:41:19.239765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-93c36d50-0ead-4c24-9176-640772cf55a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:41:19.247978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 736/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 8 13:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:41:19.287151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bc0d0-e6fb-4869-a760-b578e5247c78 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:41:19.298089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bc0d0-e6fb-4869-a760-b578e5247c78 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:41:19.301548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae006e10-452b-4b6d-b3b9-8662351b33bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:41:19.302181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006e10-452b-4b6d-b3b9-8662351b33bb service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:41:19.302491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006e10-452b-4b6d-b3b9-8662351b33bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:41:19.302767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006e10-452b-4b6d-b3b9-8662351b33bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:41:19.312218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006e10-452b-4b6d-b3b9-8662351b33bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:41:19.313649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006e10-452b-4b6d-b3b9-8662351b33bb service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:41:19.327125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 757/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:41:29.233687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=33 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:41:29.318880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=33 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:42:55.142347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b5645-0a27-4315-b308-052392a9f736 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.142900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b5645-0a27-4315-b308-052392a9f736 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.142900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b5645-0a27-4315-b308-052392a9f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.160940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-972b5645-0a27-4315-b308-052392a9f736 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:42:55.162113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-972b5645-0a27-4315-b308-052392a9f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:55.170325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 737/1494] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:42:55.177972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.178465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.178584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.196804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:42:55.197968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:55.205859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 758/1495] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:42:55.210413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b5645-0a27-4315-b308-052392a9f736 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.220899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b5645-0a27-4315-b308-052392a9f736 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.225397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.226044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.226323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.226595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.227308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:42:55.227612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.228641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:55.228641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:42:55.228641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:42:55.229506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.241595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 738/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:42:55.249340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.258197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640fec-d790-4a27-9deb-d217bffdf255 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.262611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.263265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.263541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.263811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.264520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.266261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:55.266261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:42:55.266261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:42:55.267429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.376541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 759/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:42:55 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:42:55.380758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.390615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aed25-3595-4ea2-87e4-f9458a7d2c9d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.447042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.447714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.447996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.448304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.449006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.450017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:55.450017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:42:55.450017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:42:55.452074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.519539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 739/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:42:55 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:42:55.523686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.535109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660287e-99dd-4808-9ca8-6967304c72c2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.541806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.541806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.541806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.541806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.542432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.542705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:55.542705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:42:55.542705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:42:55.543578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.556489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 760/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:42:55.560442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.570287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d2bf-cf60-4dce-a97b-62ec797349b4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.574742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.575383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.576245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.576533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.577245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.578265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:55.578265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:42:55.578265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:42:55.579150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc3b75-a3ff-4809-843f-4e9595fc0f56 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.592956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 740/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:42:55.597198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.606831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64599-45a3-42a4-aab1-dc7a2d727d96 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.611558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.612465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.612743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.613014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] PATH_INFO: `/v3/projects/7d99fb8727104ff6a149b74cd1c0045a/users/4dd2ddc1050a4e65bc4791bea7263d9a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.627270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d99fb8727104ff6a149b74cd1c0045a, user_id=4dd2ddc1050a4e65bc4791bea7263d9a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.628323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:55.628323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:42:55.628323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:42:55.630228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b119f-dfa4-46cd-b13b-00cd4dd609c4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.735906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 761/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:42:55 2022] PUT /identity/v3/projects/7d99fb8727104ff6a149b74cd1c0045a/users/4dd2ddc1050a4e65bc4791bea7263d9a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:42:55.748168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f42e-7659-4a21-b5b0-98989c26e4d0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.748460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f42e-7659-4a21-b5b0-98989c26e4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.748742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f42e-7659-4a21-b5b0-98989c26e4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.775388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5e27f42e-7659-4a21-b5b0-98989c26e4d0 None None] MFA Rules not processed for user `4dd2ddc1050a4e65bc4791bea7263d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:42:55.776654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e27f42e-7659-4a21-b5b0-98989c26e4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:55.840085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 741/1502] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:42:55.853397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5834976-2b5f-48d9-8ca6-668e81bb8298 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.853691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5834976-2b5f-48d9-8ca6-668e81bb8298 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.853966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5834976-2b5f-48d9-8ca6-668e81bb8298 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.855315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 762/1503] 10.222.0.55 () {54 vars in 963 bytes} [Wed Jun 8 13:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:42:55.860300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231536-a143-4bb2-adc7-22a841c64f91 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.860590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231536-a143-4bb2-adc7-22a841c64f91 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.860868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231536-a143-4bb2-adc7-22a841c64f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.879001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ad231536-a143-4bb2-adc7-22a841c64f91 None None] MFA Rules not processed for user `0a04840b445544828154575b4ac4a241`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:42:55.880207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ad231536-a143-4bb2-adc7-22a841c64f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:55.922818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:42:55.929722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 742/1504] 10.222.0.55 () {58 vars in 1060 bytes} [Wed Jun 8 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:42:55.938075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5834976-2b5f-48d9-8ca6-668e81bb8298 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:55.948763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5834976-2b5f-48d9-8ca6-668e81bb8298 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:55.953187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:55.953823 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:55.954106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:55.954383 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:55.962530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:55.963961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:55.973671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 763/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:42:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:42:56.023491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e4003-5537-4b05-a321-c1be59aa0d81 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:56.027145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e4003-5537-4b05-a321-c1be59aa0d81 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:56.027145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e4003-5537-4b05-a321-c1be59aa0d81 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:56.027145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 743/1506] 10.222.0.55 () {52 vars in 829 bytes} [Wed Jun 8 13:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:42:56.028992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:56.090841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b536-221e-4988-a0b5-98486a8fdadd service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:56.095670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:56.096576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:56.096857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:56.097131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] PATH_INFO: `/v3/users/4dd2ddc1050a4e65bc4791bea7263d9a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:56.098311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd2ddc1050a4e65bc4791bea7263d9a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:56.099331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:56.099331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:42:56.099331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:42:56.100556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:56.302771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd2ddc1050a4e65bc4791bea7263d9a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:56.303466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd2ddc1050a4e65bc4791bea7263d9a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:56.380694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd2ddc1050a4e65bc4791bea7263d9a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:56.381371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd2ddc1050a4e65bc4791bea7263d9a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:56.395483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd2ddc1050a4e65bc4791bea7263d9a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:56.412761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:42:56.421264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 764/1507] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:42:56 2022] DELETE /identity/v3/users/4dd2ddc1050a4e65bc4791bea7263d9a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:42:56.425624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:56.426115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:56.426345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:56.445487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:42:56.446674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:56.510616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 744/1508] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:42:56.520423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:56.521859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:56.584009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e694fc-6eb7-4ff1-a956-15a8a1d98426 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:56.588267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163ebd-acd6-449c-bf1f-511a8b22cf98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:56.588938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163ebd-acd6-449c-bf1f-511a8b22cf98 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:56.589217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163ebd-acd6-449c-bf1f-511a8b22cf98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:56.589495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163ebd-acd6-449c-bf1f-511a8b22cf98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:56.600594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163ebd-acd6-449c-bf1f-511a8b22cf98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:56.602050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163ebd-acd6-449c-bf1f-511a8b22cf98 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:56.612376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 765/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:42:57.161066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:42:57.164764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:42:57.174997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea40a5-97b7-4366-bbc1-fdf7afd352c6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:42:57.180269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:42:57.181174 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:42:57.181482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:42:57.181762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] PATH_INFO: `/v3/projects/7d99fb8727104ff6a149b74cd1c0045a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:42:57.184186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d99fb8727104ff6a149b74cd1c0045a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:42:57.184186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:42:57.184186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:42:57.184186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:42:57.185419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:42:57.329282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d99fb8727104ff6a149b74cd1c0045a', 'request_id': 'req-aac43b0c-9ffe-420e-98ae-deda030a2c41'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:57.342793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d99fb8727104ff6a149b74cd1c0045a', 'request_id': 'req-aac43b0c-9ffe-420e-98ae-deda030a2c41'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:57.431181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d99fb8727104ff6a149b74cd1c0045a', 'request_id': 'req-aac43b0c-9ffe-420e-98ae-deda030a2c41'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:57.443879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] The token cache is being invalidate because project 7d99fb8727104ff6a149b74cd1c0045a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:42:57.444218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:57.444860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-aac43b0c-9ffe-420e-98ae-deda030a2c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:42:57.446552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 745/1510] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:42:57 2022] DELETE /identity/v3/projects/7d99fb8727104ff6a149b74cd1c0045a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:43:06.608143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:43:07.440287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:44:35.444393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c85c49-407d-4177-b719-db7beb0ae9c7 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:35.444854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c85c49-407d-4177-b719-db7beb0ae9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:35.445014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c85c49-407d-4177-b719-db7beb0ae9c7 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:35.446459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:44:35.451980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce5adb-8d6b-423f-a78d-45c47ec1f7a6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:35.452480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce5adb-8d6b-423f-a78d-45c47ec1f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:35.452604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce5adb-8d6b-423f-a78d-45c47ec1f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:35.472498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e2ce5adb-8d6b-423f-a78d-45c47ec1f7a6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:35.473720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e2ce5adb-8d6b-423f-a78d-45c47ec1f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:35.534338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:44:35.701436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c85c49-407d-4177-b719-db7beb0ae9c7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:35.704625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-39c85c49-407d-4177-b719-db7beb0ae9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:35.776850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c85c49-407d-4177-b719-db7beb0ae9c7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:35.783020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e7e89-dae3-4cee-b436-c6cb9f4ef0bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:35.783680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7e89-dae3-4cee-b436-c6cb9f4ef0bb service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:35.783954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7e89-dae3-4cee-b436-c6cb9f4ef0bb service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:35.784258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7e89-dae3-4cee-b436-c6cb9f4ef0bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:35.792565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7e89-dae3-4cee-b436-c6cb9f4ef0bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:35.794182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7e89-dae3-4cee-b436-c6cb9f4ef0bb service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:35.804118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 767/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:44:36.241227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0bcb2-1371-454e-a281-82756510cf90 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:36.241556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0bcb2-1371-454e-a281-82756510cf90 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:36.241954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0bcb2-1371-454e-a281-82756510cf90 None None] PATH_INFO: `/v3` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:36.243382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 747/1514] 10.222.0.61 () {54 vars in 925 bytes} [Wed Jun 8 13:44:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:44:36.249788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717aad-fe80-4ec1-b06b-96dea357e28a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:36.250080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717aad-fe80-4ec1-b06b-96dea357e28a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:36.250361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717aad-fe80-4ec1-b06b-96dea357e28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:36.268867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-07717aad-fe80-4ec1-b06b-96dea357e28a None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:36.270058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-07717aad-fe80-4ec1-b06b-96dea357e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:36.332404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 768/1515] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Jun 8 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:44:36.683997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd26bc-98cb-4cd4-b21c-c8e5ee5babc9 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:36.684587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd26bc-98cb-4cd4-b21c-c8e5ee5babc9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:36.684587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd26bc-98cb-4cd4-b21c-c8e5ee5babc9 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:36.686521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:44:36.691182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726744-5eea-4939-af61-ceb809d015c8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:36.691578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726744-5eea-4939-af61-ceb809d015c8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:36.691732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726744-5eea-4939-af61-ceb809d015c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:36.709317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-8f726744-5eea-4939-af61-ceb809d015c8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:36.710495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8f726744-5eea-4939-af61-ceb809d015c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:36.718193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:44:36.867596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd26bc-98cb-4cd4-b21c-c8e5ee5babc9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:36.882636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd26bc-98cb-4cd4-b21c-c8e5ee5babc9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:36.887926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72ae0-9fe5-4a9c-a54b-51db2e5b7fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:36.888830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72ae0-9fe5-4a9c-a54b-51db2e5b7fc6 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:36.889117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72ae0-9fe5-4a9c-a54b-51db2e5b7fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:36.889397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72ae0-9fe5-4a9c-a54b-51db2e5b7fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:36.897456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72ae0-9fe5-4a9c-a54b-51db2e5b7fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:36.899065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72ae0-9fe5-4a9c-a54b-51db2e5b7fc6 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:36.908626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 749/1518] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:44:40.431390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9b24b-8275-4ca1-897b-0c3489658d0b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:40.431976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9b24b-8275-4ca1-897b-0c3489658d0b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:40.431976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9b24b-8275-4ca1-897b-0c3489658d0b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:40.433341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 770/1519] 10.222.0.55 () {54 vars in 960 bytes} [Wed Jun 8 13:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:44:40.439226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0188-e858-4855-88c9-894e2300808c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:40.439664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0188-e858-4855-88c9-894e2300808c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:40.439781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0188-e858-4855-88c9-894e2300808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:40.457695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-21fd0188-e858-4855-88c9-894e2300808c None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:40.458880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-21fd0188-e858-4855-88c9-894e2300808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:40.467262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 750/1520] 10.222.0.55 () {58 vars in 1057 bytes} [Wed Jun 8 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:44:40.474709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9b24b-8275-4ca1-897b-0c3489658d0b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:40.488668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9b24b-8275-4ca1-897b-0c3489658d0b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:40.493535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be64d9-f72c-4520-9a6e-7b97c5de5d70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:40.494156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be64d9-f72c-4520-9a6e-7b97c5de5d70 service placement] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:40.494436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be64d9-f72c-4520-9a6e-7b97c5de5d70 service placement] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:40.494707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be64d9-f72c-4520-9a6e-7b97c5de5d70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:40.503396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be64d9-f72c-4520-9a6e-7b97c5de5d70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:40.504996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be64d9-f72c-4520-9a6e-7b97c5de5d70 service placement] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:40.514360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 771/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:44:48.195012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770f03-3c99-41f6-ba75-4d0f04f76483 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:48.195576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770f03-3c99-41f6-ba75-4d0f04f76483 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:48.195576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770f03-3c99-41f6-ba75-4d0f04f76483 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:48.196956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:44:48.201648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9ace-c78d-4942-bce8-dd2c6337e65f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:48.202096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9ace-c78d-4942-bce8-dd2c6337e65f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:48.202203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9ace-c78d-4942-bce8-dd2c6337e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:48.220813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-298e9ace-c78d-4942-bce8-dd2c6337e65f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:48.222250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-298e9ace-c78d-4942-bce8-dd2c6337e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:48.230237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:44:48.388478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770f03-3c99-41f6-ba75-4d0f04f76483 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:48.402651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770f03-3c99-41f6-ba75-4d0f04f76483 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:48.408775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91825c12-5dea-4782-a734-413346700f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:48.409411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825c12-5dea-4782-a734-413346700f81 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:48.409689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825c12-5dea-4782-a734-413346700f81 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:48.409961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825c12-5dea-4782-a734-413346700f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:48.418086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91825c12-5dea-4782-a734-413346700f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:48.420400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91825c12-5dea-4782-a734-413346700f81 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:48.429729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 752/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:44:49.288729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb963bc-c3c9-46d6-8de0-148cd0637f6b None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:49.289278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb963bc-c3c9-46d6-8de0-148cd0637f6b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:49.289278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb963bc-c3c9-46d6-8de0-148cd0637f6b None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:49.290608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 13:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:44:49.295817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec3a55-77af-4f9c-94e4-86efd67c861e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:49.296288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec3a55-77af-4f9c-94e4-86efd67c861e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:49.296401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec3a55-77af-4f9c-94e4-86efd67c861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:49.314040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7fec3a55-77af-4f9c-94e4-86efd67c861e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:49.315210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7fec3a55-77af-4f9c-94e4-86efd67c861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:49.322954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:44:49.478492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb963bc-c3c9-46d6-8de0-148cd0637f6b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:49.493493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb963bc-c3c9-46d6-8de0-148cd0637f6b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:49.499501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ef260-a56b-42d9-aa86-f5df1daf5612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:49.499744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef260-a56b-42d9-aa86-f5df1daf5612 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:49.500033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef260-a56b-42d9-aa86-f5df1daf5612 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:49.500463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef260-a56b-42d9-aa86-f5df1daf5612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:49.509183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ef260-a56b-42d9-aa86-f5df1daf5612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:49.510817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ef260-a56b-42d9-aa86-f5df1daf5612 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:49.521273 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 774/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:44:53.596720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4ac4-64eb-4fa4-8f66-9fe48de9809a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:53.597320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4ac4-64eb-4fa4-8f66-9fe48de9809a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:53.597320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4ac4-64eb-4fa4-8f66-9fe48de9809a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:53.598649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:44:53.603773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a91a-9605-4e12-afa8-45dcede5aff5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:53.604338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a91a-9605-4e12-afa8-45dcede5aff5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:53.604451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a91a-9605-4e12-afa8-45dcede5aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:53.622399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4dc7a91a-9605-4e12-afa8-45dcede5aff5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:53.623664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4dc7a91a-9605-4e12-afa8-45dcede5aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:53.631383 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:44:53.667775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc4ac4-64eb-4fa4-8f66-9fe48de9809a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:53.669749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fbcc4ac4-64eb-4fa4-8f66-9fe48de9809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:53.726442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc4ac4-64eb-4fa4-8f66-9fe48de9809a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:53.729915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761a3f-63b3-469f-8f99-bcb41ddc5d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:53.730553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761a3f-63b3-469f-8f99-bcb41ddc5d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:53.730838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761a3f-63b3-469f-8f99-bcb41ddc5d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:53.731141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761a3f-63b3-469f-8f99-bcb41ddc5d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:53.740011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761a3f-63b3-469f-8f99-bcb41ddc5d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:53.741451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761a3f-63b3-469f-8f99-bcb41ddc5d29 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:53.751318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 755/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:44:56.014749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b9449-2372-4ac7-b62c-40553b8995d1 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:56.015322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b9449-2372-4ac7-b62c-40553b8995d1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:56.015322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b9449-2372-4ac7-b62c-40553b8995d1 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:56.016792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:44:56.022037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86babc8d-d696-42b5-8211-21bc9ccf047a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:56.022478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86babc8d-d696-42b5-8211-21bc9ccf047a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:56.022608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86babc8d-d696-42b5-8211-21bc9ccf047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:56.040666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-86babc8d-d696-42b5-8211-21bc9ccf047a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:44:56.041889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-86babc8d-d696-42b5-8211-21bc9ccf047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:44:56.050028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:44:56.086883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b9449-2372-4ac7-b62c-40553b8995d1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:44:56.098259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b9449-2372-4ac7-b62c-40553b8995d1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:44:56.101838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59105c4e-d143-4396-b22d-69cd2d08bb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:44:56.102475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59105c4e-d143-4396-b22d-69cd2d08bb3e service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:44:56.102756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59105c4e-d143-4396-b22d-69cd2d08bb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:44:56.103027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59105c4e-d143-4396-b22d-69cd2d08bb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:44:56.112467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59105c4e-d143-4396-b22d-69cd2d08bb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:44:56.113895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59105c4e-d143-4396-b22d-69cd2d08bb3e service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:44:56.123767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 777/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:45:00.047218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e09cb-09bf-4609-a666-c1267be1d6cc None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:45:00.047804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e09cb-09bf-4609-a666-c1267be1d6cc None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:45:00.047804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e09cb-09bf-4609-a666-c1267be1d6cc None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:45:00.049219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:45:00.054491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593a64-4058-45c4-8f3e-519f5c8d2618 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:45:00.054944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593a64-4058-45c4-8f3e-519f5c8d2618 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:45:00.055054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593a64-4058-45c4-8f3e-519f5c8d2618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:45:00.061881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:45:00.075274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-73593a64-4058-45c4-8f3e-519f5c8d2618 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:45:00.076498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-73593a64-4058-45c4-8f3e-519f5c8d2618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:45:00.084183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:45:00.355462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e09cb-09bf-4609-a666-c1267be1d6cc None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:45:00.357340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fc3e09cb-09bf-4609-a666-c1267be1d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:45:00.363143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=75 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:45:00.416436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e09cb-09bf-4609-a666-c1267be1d6cc None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:45:00.420021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55674bd6-6dae-4a39-80d4-f68625621152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:45:00.420689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674bd6-6dae-4a39-80d4-f68625621152 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:45:00.420967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674bd6-6dae-4a39-80d4-f68625621152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:45:00.421244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674bd6-6dae-4a39-80d4-f68625621152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:45:00.429927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674bd6-6dae-4a39-80d4-f68625621152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:45:00.431328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674bd6-6dae-4a39-80d4-f68625621152 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:45:00.441103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 758/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:45:02.759810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85e9bc-e71f-459b-aead-c2713d7dca66 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:45:02.760419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85e9bc-e71f-459b-aead-c2713d7dca66 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:45:02.760419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85e9bc-e71f-459b-aead-c2713d7dca66 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:45:02.761773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 13:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:45:02.767454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efac60-5341-4b11-9f4b-41711b611d28 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:45:02.767911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efac60-5341-4b11-9f4b-41711b611d28 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:45:02.768026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efac60-5341-4b11-9f4b-41711b611d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:45:02.786138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d1efac60-5341-4b11-9f4b-41711b611d28 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:45:02.787331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d1efac60-5341-4b11-9f4b-41711b611d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:45:02.795956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 13:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:45:03.062424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85e9bc-e71f-459b-aead-c2713d7dca66 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:45:03.064126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9b85e9bc-e71f-459b-aead-c2713d7dca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:45:03.077429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85e9bc-e71f-459b-aead-c2713d7dca66 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:45:03.080936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf3c4-74b3-4d6c-a081-6c59fb2ee2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:45:03.081564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf3c4-74b3-4d6c-a081-6c59fb2ee2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:45:03.081842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf3c4-74b3-4d6c-a081-6c59fb2ee2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:45:03.082132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf3c4-74b3-4d6c-a081-6c59fb2ee2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:45:03.091814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf3c4-74b3-4d6c-a081-6c59fb2ee2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:45:03.093282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf3c4-74b3-4d6c-a081-6c59fb2ee2b5 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:45:03.103085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 780/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:45:12.781387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=28 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:45:13.098804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=8 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:32.293813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.294447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.294447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.326554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:32.328189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:32.341057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 760/1540] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:32.350235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.352802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.353336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.385250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:32.386839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:32.395449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 781/1541] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:32.402323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:32.413930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312a8b-c06a-444f-ae41-0cf33fe51a96 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:32.423931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:32.424975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.425488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.425978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.426916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:32.427433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:32.429263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:32.443064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 761/1542] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:32.452465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:32.463290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5193afa-afc0-4a26-b2c8-71a2bd98f9d0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:32.471126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab982abe-d4b6-4c1a-9821-6a94e18d6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:32.472347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab982abe-d4b6-4c1a-9821-6a94e18d6ded admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.472867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab982abe-d4b6-4c1a-9821-6a94e18d6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.473342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab982abe-d4b6-4c1a-9821-6a94e18d6ded admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.474234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab982abe-d4b6-4c1a-9821-6a94e18d6ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:32.476396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab982abe-d4b6-4c1a-9821-6a94e18d6ded admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:32.628907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 782/1543] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:32.632766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:32.643291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d005bb-9325-41de-a4b6-0553c0879a03 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:32.743403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:32.744694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.745234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.745724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.747594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:32.749787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:32.845872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4698bd3-6167-43cb-9a10-65c1365ea7bc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.846878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4698bd3-6167-43cb-9a10-65c1365ea7bc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.847600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4698bd3-6167-43cb-9a10-65c1365ea7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.856186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 762/1544] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:32.860999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:32.877670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77c8a-2c28-4a31-94c3-02ad7b4b5ec9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:32.878417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-b4698bd3-6167-43cb-9a10-65c1365ea7bc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:32.880283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b4698bd3-6167-43cb-9a10-65c1365ea7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:32.889616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a6daf-a959-42fb-948e-cde66beac155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:32.890317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a6daf-a959-42fb-948e-cde66beac155 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.890606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a6daf-a959-42fb-948e-cde66beac155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.890911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a6daf-a959-42fb-948e-cde66beac155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.891648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a6daf-a959-42fb-948e-cde66beac155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:32.894183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a6daf-a959-42fb-948e-cde66beac155 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:32.899973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 783/1545] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:32.901824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e642304-a7e3-4954-beb4-4de108529474 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.902367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e642304-a7e3-4954-beb4-4de108529474 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.902905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e642304-a7e3-4954-beb4-4de108529474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.919764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 763/1546] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:32.921358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.921659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.921942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.937952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9e642304-a7e3-4954-beb4-4de108529474 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:32.939765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9e642304-a7e3-4954-beb4-4de108529474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:32.953616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 784/1547] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:32.955220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7037-723c-40f0-a951-d164a94237df None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:32.955727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7037-723c-40f0-a951-d164a94237df None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:32.956269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7037-723c-40f0-a951-d164a94237df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:32.977729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:32.984077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:32.985715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-472e7037-723c-40f0-a951-d164a94237df None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:32.987130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-472e7037-723c-40f0-a951-d164a94237df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.002763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 764/1548] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.003367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 785/1549] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.003814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.005215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.005737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.006245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.028081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e061f-e054-43c4-b476-e75b9bc7a969 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.037587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc1912-fa5f-40c7-a554-31bb91c34eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.038425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc1912-fa5f-40c7-a554-31bb91c34eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.038718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc1912-fa5f-40c7-a554-31bb91c34eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.038994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc1912-fa5f-40c7-a554-31bb91c34eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.040003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc1912-fa5f-40c7-a554-31bb91c34eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.040339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.041670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc1912-fa5f-40c7-a554-31bb91c34eaa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.042110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.052780 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 786/1550] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.053946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.066764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 765/1551] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:33.075113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.075113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.075113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.075358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5567-28ba-4524-9554-7763985ca368 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.079480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.080686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.081341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.081839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.082859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:33.083388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.084677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:46:33.084677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:46:33.084677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:46:33.085963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122d936-623e-4386-a903-325d4d9a4c5d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.089374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.090810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.099933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 766/1552] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.104436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.115094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb09d-b0cd-439a-bb6c-b097e3a72d7f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.119915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 787/1553] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:33.120398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.121076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.121364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.121642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.122382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:33.122690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.124202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.124487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424715a-1ab8-4ac9-b235-3f824ce51976 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.124993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.125491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.138836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 767/1554] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:33.140476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.140765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.141042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.149827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.151380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.160836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.161917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 788/1555] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.163014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.163965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.172756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 768/1556] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.173577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.176216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11a3ab-0c4e-4e85-841f-f9ea0d065af7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.182184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.183192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.183575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.184527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] PATH_INFO: `/v3/projects/8ed663d9fbec493680ccb284f19cf681/users/16de1f8ed11f478bade53ff22e9ba062/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.184938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409af3a-cfea-452d-8e03-e618a4613687 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.191671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.192362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.192648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.192926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.193927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:33.193927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.196210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.201989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed663d9fbec493680ccb284f19cf681, user_id=16de1f8ed11f478bade53ff22e9ba062, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.204687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.214774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 769/1557] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:33.214774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.220540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09ed5-31d1-4234-9267-2ee96696bf05 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.225558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.226214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.226497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.226983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.227953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.229002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:46:33.229002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:46:33.229002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:46:33.230186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ccf27-2e6c-475f-a005-80f35b9e43a5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.281102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 789/1558] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:33 2022] PUT /identity/v3/projects/8ed663d9fbec493680ccb284f19cf681/users/16de1f8ed11f478bade53ff22e9ba062/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:33.282000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.329310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 770/1559] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:33.330719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5eaf4-c5ea-4355-aa5b-8d5c1362e3b9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.330980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5eaf4-c5ea-4355-aa5b-8d5c1362e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.331260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5eaf4-c5ea-4355-aa5b-8d5c1362e3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.345545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e148a2-d33f-4aa5-ac08-5414f8ba6ce4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.353879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-86f5eaf4-c5ea-4355-aa5b-8d5c1362e3b9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.355128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-86f5eaf4-c5ea-4355-aa5b-8d5c1362e3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.389984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:33.406624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab5253-920e-4d60-ae0b-2f0273ad9931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.411553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab5253-920e-4d60-ae0b-2f0273ad9931 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.411553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab5253-920e-4d60-ae0b-2f0273ad9931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.411553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab5253-920e-4d60-ae0b-2f0273ad9931 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.411553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab5253-920e-4d60-ae0b-2f0273ad9931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.411553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab5253-920e-4d60-ae0b-2f0273ad9931 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.416639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 771/1560] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.417916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d33b6-7c17-4ab1-b8f1-3114f7bba30e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.418201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d33b6-7c17-4ab1-b8f1-3114f7bba30e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.418480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d33b6-7c17-4ab1-b8f1-3114f7bba30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.425506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:33.439148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9c2d33b6-7c17-4ab1-b8f1-3114f7bba30e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.440374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9c2d33b6-7c17-4ab1-b8f1-3114f7bba30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.448938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 772/1561] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.450140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.450492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.450775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.467777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.469078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.477347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 773/1562] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.478239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.482521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 790/1563] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:33.483827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77025b2-6444-4f5a-b3da-8616cd4d2b11 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.484146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77025b2-6444-4f5a-b3da-8616cd4d2b11 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.484433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77025b2-6444-4f5a-b3da-8616cd4d2b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.488357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e420-265e-4323-bf5f-e40db05039b2 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.503446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f77025b2-6444-4f5a-b3da-8616cd4d2b11 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.504673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f77025b2-6444-4f5a-b3da-8616cd4d2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.545520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.546211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.546492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.546761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.547443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.549356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.565527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 791/1564] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.566827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b21f9a-e119-4f9e-be68-4b71b3c72631 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.567114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b21f9a-e119-4f9e-be68-4b71b3c72631 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.567390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b21f9a-e119-4f9e-be68-4b71b3c72631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.595474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a4b21f9a-e119-4f9e-be68-4b71b3c72631 None None] MFA Rules not processed for user `16de1f8ed11f478bade53ff22e9ba062`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.597034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a4b21f9a-e119-4f9e-be68-4b71b3c72631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.630887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 774/1565] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:33.631977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.662772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 792/1566] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.663985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.664805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.665222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.684007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.685340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.696312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eaea8-c2b2-41b3-b0df-a949f3c86613 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.700952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72335-35bc-4d7e-ba98-620555c4eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.701620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72335-35bc-4d7e-ba98-620555c4eb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.701900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72335-35bc-4d7e-ba98-620555c4eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.702175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72335-35bc-4d7e-ba98-620555c4eb8c admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.702861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72335-35bc-4d7e-ba98-620555c4eb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.704822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72335-35bc-4d7e-ba98-620555c4eb8c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.744687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 793/1567] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.745535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.755773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aeda-678d-418f-b4d6-99a5f51092d4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.761095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.761741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.762025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.762302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.763020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:33.763329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.765020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.776952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 794/1568] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:33.777803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.787153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8f1d-ef0d-457a-8b39-15417ef124a2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.792283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876866ad-d661-404a-962d-af613c424378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.792894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876866ad-d661-404a-962d-af613c424378 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.793174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876866ad-d661-404a-962d-af613c424378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.793473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876866ad-d661-404a-962d-af613c424378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.794168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876866ad-d661-404a-962d-af613c424378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:33.794465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876866ad-d661-404a-962d-af613c424378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.796001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876866ad-d661-404a-962d-af613c424378 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.802897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:33.808536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 795/1569] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:33.809447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876866ad-d661-404a-962d-af613c424378 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.818425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876866ad-d661-404a-962d-af613c424378 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.823314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:46:33.827673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:46:33.828359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.829537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 775/1570] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:33.830875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.831158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.831455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.849430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:33.850655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:33.859131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 776/1571] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:33.859864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.869873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f44cc6-7f31-40fc-b49e-1b1a24cbf3ef None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.874545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.875207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.875485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.875757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.876471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.878343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.907778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 796/1572] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:33.908718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.918710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20f52a-715e-4826-b95e-413a7a482871 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.923105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.923740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.924004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.924309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.924981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.926866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:33.979892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 777/1573] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:33.980780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:33.990417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e05b4e-6362-4010-a68e-6a4db3f8182b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:33.995859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:33.996541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:33.996825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:33.997124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:33.997837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:33.998132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:33.999791 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.003859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 797/1574] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] POST /identity/v3/projects => generated 361 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.003859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.019473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 778/1575] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:34.019473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.028011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:34.031903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590beb4-8213-460a-94af-2552921319d1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.069720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f374d0-6c7b-4200-b8ea-a9513c58b099 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.074694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.075450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.079809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.080220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.080821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.082757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.095014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.095691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.095984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.096294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.097302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.099693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.195137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 798/1576] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.196446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.204138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 779/1577] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.206329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.261826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d23b41-3fd9-4470-8516-ea975862b9ff admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.266454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.267124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.267413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.267690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.267930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445dd2e-a502-4944-8e95-734560a5520f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.268440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.270054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.272739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.274066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.274377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.274677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.275597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:34.275911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.277599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.280859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 799/1578] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.281795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.290380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 780/1579] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:34.291035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.294329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8fc1f-c9ee-4975-bed1-2c1b70ad3f92 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.299752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.300445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd719c-4eaa-4570-807c-7e519bbaaa6f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.300598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.300708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.300986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.301731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.303322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.305019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.305768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.306043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.306320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.307070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.308743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.313552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 800/1580] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.314327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.323093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 781/1581] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.323763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.324717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a2a9a-a76c-483f-bda0-1d2709d56f79 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.329505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.330154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.330439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.330716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.331541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.333203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0c3d-894b-417a-954f-b993a4031190 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.333675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.338337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.338967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.339249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.339529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.340243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.342102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.458502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 801/1582] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.459379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.470018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bc2b2-39ba-4197-9847-5445aac1ab1e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.474871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.475506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.475794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.476093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.476872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.479161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.487774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:34.492313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 782/1583] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.492313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.538718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:34.550183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840784d9-408a-4003-bc30-942863b28d4d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.554798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.555476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.555757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.556107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.556824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.558730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.600585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 802/1584] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.601793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.611373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7778-a4d2-462a-9ab3-131a4a08c77a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.615822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.616486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.616765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.617039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.617771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.619350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.628824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 803/1585] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.629685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.640297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce13b4-9b59-4ec7-b6b4-5f9b2fe4742d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.644835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.645511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.645748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.653072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.653072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.653340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 783/1586] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.653340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.653509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.657943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8307183-fe6f-43c8-902a-f89fc4d3b99a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.662606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.663258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.663539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.663820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.664701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.666285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.676816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 784/1587] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.677604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.687481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8b32e-f403-4f0a-877f-d3b978a4f0ca admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.692002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.692686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.692954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.693227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.693922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.696095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.705899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 785/1588] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.706795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.716450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51af3-0962-4d32-9ab6-c01ae0a933cc admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.721025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.721910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.722186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.722462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.724405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.729293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.731569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 804/1589] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.732466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.739863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 786/1590] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.740780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.750867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a24e-1082-41c8-9c02-30050944499b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.800282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777137b8-3386-4876-b8c0-ebdbc82c672c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.805261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.806023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.806301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.806576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.807286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.808543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.809213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.809337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.809511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.809780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.810503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.812099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.823080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 787/1591] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.823925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.833315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb9bc-2faf-4a5e-b019-102204db6990 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.838060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.838951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.839231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.839506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] PATH_INFO: `/v3/projects/4613903d92f44ca284ebffce3961204d/users/e6a2825f34ec4adf90cac06ec981bc42/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.854066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4613903d92f44ca284ebffce3961204d, user_id=e6a2825f34ec4adf90cac06ec981bc42, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.855081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:46:34.855081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:46:34.855081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:46:34.857121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.897657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 805/1592] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:34 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:34.898705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.908194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aaf62-1d1f-4905-9fa5-7bca9e27941f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.912644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.913266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:34.913546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:34.913820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:34.914666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:34.916167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:34.926070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 806/1593] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:34.938216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 788/1594] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:34 2022] PUT /identity/v3/projects/4613903d92f44ca284ebffce3961204d/users/e6a2825f34ec4adf90cac06ec981bc42/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:34.938445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.938561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:34.939735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527a42-22ce-4a72-8a37-40adca58165e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.995790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6437a-7e33-4b07-b007-7e3731e02291 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:34.998877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:34.999759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.000046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.000356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] PATH_INFO: `/v3/projects/de2efde7c7f640b88acb575ea7fd50b8/users/0b277a221f4042fcae368507f572171b/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.000456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.001402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.001694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.001970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] PATH_INFO: `/v3/projects/9e6598a073a442958076b48bed28c472/users/8fd00cf03b884d8999591ae4db0c1bc5/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.017255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2efde7c7f640b88acb575ea7fd50b8, user_id=0b277a221f4042fcae368507f572171b, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.017746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6598a073a442958076b48bed28c472, user_id=8fd00cf03b884d8999591ae4db0c1bc5, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.019950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.020556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.098547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 807/1595] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:34 2022] PUT /identity/v3/projects/de2efde7c7f640b88acb575ea7fd50b8/users/0b277a221f4042fcae368507f572171b/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:35.099356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.115523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 789/1596] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:34 2022] PUT /identity/v3/projects/9e6598a073a442958076b48bed28c472/users/8fd00cf03b884d8999591ae4db0c1bc5/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:35.116373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.122840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.125524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.160806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd955e7-2585-4479-bc07-28c199e1f473 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.181094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be7c7-2b1c-40cc-8aa3-31b91d355d7e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.186242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.187140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.187490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.187785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] PATH_INFO: `/v3/projects/f28542a2d3394f85b7717788deaf94ae/users/525580a1705b4e868a2c091222a52a4a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.202799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28542a2d3394f85b7717788deaf94ae, user_id=525580a1705b4e868a2c091222a52a4a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.205527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.218434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.219122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.219402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.219709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.220448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.222723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.313250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 790/1597] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:35 2022] PUT /identity/v3/projects/f28542a2d3394f85b7717788deaf94ae/users/525580a1705b4e868a2c091222a52a4a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:35.314270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.336402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 808/1598] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:35 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:35.339906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.349201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2d41a-3d87-4e1d-b92d-5e27a5aba7b3 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.377273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d958-b9a0-4f26-accc-a1b6ebcca8bc admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.382242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.383132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.383500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.383800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.384540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.386138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.401940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 791/1599] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:35.402913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.410834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ed597-e1c2-499b-9868-2317b4bb2485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.415579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ed597-e1c2-499b-9868-2317b4bb2485 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.415579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ed597-e1c2-499b-9868-2317b4bb2485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.415579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ed597-e1c2-499b-9868-2317b4bb2485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.415885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057361-830f-4d17-bdc9-d4973aaee8ae admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.415969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ed597-e1c2-499b-9868-2317b4bb2485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.415969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ed597-e1c2-499b-9868-2317b4bb2485 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.418789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed3ef-af75-4e58-957f-2ec52efa1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.419447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed3ef-af75-4e58-957f-2ec52efa1175 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.419735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed3ef-af75-4e58-957f-2ec52efa1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.420012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed3ef-af75-4e58-957f-2ec52efa1175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.420764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed3ef-af75-4e58-957f-2ec52efa1175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.422400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed3ef-af75-4e58-957f-2ec52efa1175 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.425483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 809/1600] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:35.426558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb6a7-15ad-4412-a76a-2530322abba2 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.426881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb6a7-15ad-4412-a76a-2530322abba2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.427167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb6a7-15ad-4412-a76a-2530322abba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.434655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 792/1601] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:35.435947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.436270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.436574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.458511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1e0fb6a7-15ad-4412-a76a-2530322abba2 None None] MFA Rules not processed for user `e6a2825f34ec4adf90cac06ec981bc42`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:35.459888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1e0fb6a7-15ad-4412-a76a-2530322abba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:35.467159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] MFA Rules not processed for user `0b277a221f4042fcae368507f572171b`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:35.468608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:35.509971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.531765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.531983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 810/1602] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:35.533125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.533408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.533681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.538535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 793/1603] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:35.541002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.556105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4032cb-06e6-4b92-a870-639e3eeea16f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.556547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:35.560192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:35.561971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.562644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.562957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.563203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.563991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.565894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.569758 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 811/1604] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:35.570117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.579894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 794/1605] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:35.580556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3f3fe-e755-45a5-8d1c-9dce5926060a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.580807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.585751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.588818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.588818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.588818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.588818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.589926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.591796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c733-e5af-4e54-874e-15c84edc0422 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.596842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.597717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.598004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.598283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] PATH_INFO: `/v3/projects/87c115dc845a497292c12e2980e9f77b/users/cc438414709747599fba278ea9b6fecf/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.600451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 812/1606] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:35.601246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.611875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753bb9-c49f-49f9-aab6-532b3ccaf39c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.616463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c115dc845a497292c12e2980e9f77b, user_id=cc438414709747599fba278ea9b6fecf, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.616921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.617598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.618037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.618149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.618348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.619099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.620720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.631004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 813/1607] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:35.631832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.642103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5946e-4e5a-424c-b832-9878e5981e0f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.647046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb9d0-3e5a-480c-a042-079add0577f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.647929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb9d0-3e5a-480c-a042-079add0577f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.648238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb9d0-3e5a-480c-a042-079add0577f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.649107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb9d0-3e5a-480c-a042-079add0577f4 admin admin] PATH_INFO: `/v3/projects/3285fa39ad9e469dae1191cc2a5fb130/users/3aabc0c440bb4db09dd507b661a278fc/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.663665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdb9d0-3e5a-480c-a042-079add0577f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3285fa39ad9e469dae1191cc2a5fb130, user_id=3aabc0c440bb4db09dd507b661a278fc, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.667073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdb9d0-3e5a-480c-a042-079add0577f4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.681903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 795/1608] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:35 2022] PUT /identity/v3/projects/87c115dc845a497292c12e2980e9f77b/users/cc438414709747599fba278ea9b6fecf/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:35.687436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.743827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00e770-ed65-4499-bdcd-45134527d879 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.748633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.749320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.749608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.749887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.750578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.752509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.806926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 814/1609] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:35 2022] PUT /identity/v3/projects/3285fa39ad9e469dae1191cc2a5fb130/users/3aabc0c440bb4db09dd507b661a278fc/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:35.808472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a14a7-0481-4342-bd52-d276a7075505 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.808759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a14a7-0481-4342-bd52-d276a7075505 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.809033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a14a7-0481-4342-bd52-d276a7075505 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.810285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 815/1610] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 8 13:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:46:35.811039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a14a7-0481-4342-bd52-d276a7075505 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.865135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a14a7-0481-4342-bd52-d276a7075505 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.869166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.869803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.870081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.870351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.900101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 796/1611] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:35 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:35.900101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.928440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.930561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.940279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 816/1612] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:35.944471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:35.950442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1006-4765-4874-84af-377a259cb376 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.960408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4f97-4219-42ba-81c7-e327f15f845d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:35.965766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:35.966671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:35.966958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:35.967233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] PATH_INFO: `/v3/projects/f28542a2d3394f85b7717788deaf94ae/users/525580a1705b4e868a2c091222a52a4a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:35.969265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28542a2d3394f85b7717788deaf94ae, user_id=525580a1705b4e868a2c091222a52a4a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:35.972267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:35.983974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 797/1613] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:35 2022] PUT /identity/v3/projects/f28542a2d3394f85b7717788deaf94ae/users/525580a1705b4e868a2c091222a52a4a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:35.993166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.011703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0245ba8-2438-4f73-9db7-a567eb639fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.012549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245ba8-2438-4f73-9db7-a567eb639fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.012904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245ba8-2438-4f73-9db7-a567eb639fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.013281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0245ba8-2438-4f73-9db7-a567eb639fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.014030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0245ba8-2438-4f73-9db7-a567eb639fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.015644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0245ba8-2438-4f73-9db7-a567eb639fd6 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.028784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 817/1614] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:36.028784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8787-f675-4389-b167-eb4270e2bfc4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.028784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8787-f675-4389-b167-eb4270e2bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.028784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8787-f675-4389-b167-eb4270e2bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.046546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5c1b8787-f675-4389-b167-eb4270e2bfc4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:36.047822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5c1b8787-f675-4389-b167-eb4270e2bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.054484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289542c-8416-4269-8ee1-27eea7b62824 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.057306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 818/1615] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:36.058600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8e6c-3e5a-4af7-965a-0223ab0559e7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.062424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8e6c-3e5a-4af7-965a-0223ab0559e7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.062424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8e6c-3e5a-4af7-965a-0223ab0559e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.063945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.065492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.065887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.066168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] PATH_INFO: `/v3/projects/9abd79bc99784c3f81991d1cae37a074/users/85e0d647620a407cbe03d83c86111f3d/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.082749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abd79bc99784c3f81991d1cae37a074, user_id=85e0d647620a407cbe03d83c86111f3d, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.089275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.096317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4f2e8e6c-3e5a-4af7-965a-0223ab0559e7 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:36.096317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4f2e8e6c-3e5a-4af7-965a-0223ab0559e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.161923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 819/1616] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:36.163412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829456e-6b67-4201-bcec-858aa721b389 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.163701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829456e-6b67-4201-bcec-858aa721b389 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.163970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829456e-6b67-4201-bcec-858aa721b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.173488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 798/1617] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:35 2022] PUT /identity/v3/projects/9abd79bc99784c3f81991d1cae37a074/users/85e0d647620a407cbe03d83c86111f3d/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:36.176559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.192709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f829456e-6b67-4201-bcec-858aa721b389 None None] MFA Rules not processed for user `3aabc0c440bb4db09dd507b661a278fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:36.193915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f829456e-6b67-4201-bcec-858aa721b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.199645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.243519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7c8f-3a5b-472c-9372-2f96b8d05652 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.248527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.249219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.249493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.249772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.250546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.252498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.260290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 820/1618] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:36.261659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.262016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.262261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.291465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] MFA Rules not processed for user `525580a1705b4e868a2c091222a52a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:36.292718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.298116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.369683 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 799/1619] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:36.374059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.376762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 821/1620] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:36.376762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.377591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.383144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142d09a-1313-4be7-9ab2-c4aedd042ed4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.388407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a6a7e-4f80-4c7d-ae21-69a60378ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.389414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6a7e-4f80-4c7d-ae21-69a60378ec56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.389755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6a7e-4f80-4c7d-ae21-69a60378ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.390672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6a7e-4f80-4c7d-ae21-69a60378ec56 admin admin] PATH_INFO: `/v3/projects/d0cc65fa99694daa81878db0200bdb4b/users/1b970b89c20645d98da510e03a915fd5/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.407678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a6a7e-4f80-4c7d-ae21-69a60378ec56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cc65fa99694daa81878db0200bdb4b, user_id=1b970b89c20645d98da510e03a915fd5, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.410612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a6a7e-4f80-4c7d-ae21-69a60378ec56 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.455017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100b284-bb33-4537-912a-70529a6c8465 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.458682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.459335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.459616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.459888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.469566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.471000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.481265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 822/1621] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:36.482039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.552397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465dbea-7473-4e17-bcc2-abb1a2c2eda0 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.557959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.558629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.558907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.559180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.579022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 800/1622] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:36 2022] PUT /identity/v3/projects/d0cc65fa99694daa81878db0200bdb4b/users/1b970b89c20645d98da510e03a915fd5/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:36.580601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.584162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.584162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.599209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:36.600475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.643527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.646115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.660370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 823/1623] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:36.661750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.668679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 801/1624] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:36.668679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.676839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feea32-8f75-4cbb-afc7-f18964829c2f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.682449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.683156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.683441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.683770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.686649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.688470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.693146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.704512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 802/1625] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:36.705719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.757078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1135-a6d2-4462-a622-02522dbcf6af service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.774794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5329ea-b6cb-4c2d-a5f0-5ea067f4b8d2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:36.787606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.800272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.800932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.801214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.801488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.828097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe4d55-2dca-47de-9509-affe6303e161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:36.829115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4d55-2dca-47de-9509-affe6303e161 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.829604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4d55-2dca-47de-9509-affe6303e161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.830111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4d55-2dca-47de-9509-affe6303e161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.870524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.889194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.891028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.895764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe4d55-2dca-47de-9509-affe6303e161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:36.897570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe4d55-2dca-47de-9509-affe6303e161 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:36.912653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 824/1626] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:36.914239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:36.914824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:36.915554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:36.917105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 803/1627] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:36.918024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:36.952317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:36.953827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:36.988570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 825/1628] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:36.989718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:37.022694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b2d9-8c81-4097-8e05-3802fc48e589 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:37.061378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb21d7f-41a5-4960-a43e-4bb7e1fcdfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:37.063095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade584b-3c29-4c9c-a1f2-572a5d9ec239 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:37.063981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21d7f-41a5-4960-a43e-4bb7e1fcdfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.067085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21d7f-41a5-4960-a43e-4bb7e1fcdfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.067488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21d7f-41a5-4960-a43e-4bb7e1fcdfe5 admin admin] PATH_INFO: `/v3/projects/b6a333ae7c5643e79777b21078fffbd1/users/b8601df2b86c411e88a98b182aa1ed44/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.074438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:37.075158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.075503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.076250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.101812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:37.104310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:37.124863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 804/1629] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:37.125113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21d7f-41a5-4960-a43e-4bb7e1fcdfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a333ae7c5643e79777b21078fffbd1, user_id=b8601df2b86c411e88a98b182aa1ed44, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:37.125774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:37.127750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21d7f-41a5-4960-a43e-4bb7e1fcdfe5 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:37.137811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34904d-2986-464a-9efc-9def62d1d417 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:37.141895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:37.142543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.142832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.143166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.154746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:37.156563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:37.184392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 805/1630] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:37.196995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 826/1631] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:36 2022] PUT /identity/v3/projects/b6a333ae7c5643e79777b21078fffbd1/users/b8601df2b86c411e88a98b182aa1ed44/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:37.210020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:37.224669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58e68-5571-4b70-a683-d7f9d49b37ef service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:37.305413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47fd9-4b77-4b05-b5e7-8346d670bdc5 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.305969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47fd9-4b77-4b05-b5e7-8346d670bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.306254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47fd9-4b77-4b05-b5e7-8346d670bdc5 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.309131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 827/1632] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 8 13:46:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:46:37.316165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972bb0d-8a38-48af-bac5-3ba1508346d6 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.317063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972bb0d-8a38-48af-bac5-3ba1508346d6 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.317395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972bb0d-8a38-48af-bac5-3ba1508346d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.358981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:37.360341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7972bb0d-8a38-48af-bac5-3ba1508346d6 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:37.361822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.362105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.362385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.368208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7972bb0d-8a38-48af-bac5-3ba1508346d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:37.383358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:37.385487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:37.390869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:37.413268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 806/1633] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:37.418690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:37.439328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6db4c-a53d-44cf-be5a-7f12f2c36af4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:37.446771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2224d-7cad-49a2-b592-f9280eb1f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:37.448226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2224d-7cad-49a2-b592-f9280eb1f032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.449014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2224d-7cad-49a2-b592-f9280eb1f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.450264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2224d-7cad-49a2-b592-f9280eb1f032 admin admin] PATH_INFO: `/v3/projects/b6a333ae7c5643e79777b21078fffbd1/users/b8601df2b86c411e88a98b182aa1ed44/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.452884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2224d-7cad-49a2-b592-f9280eb1f032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a333ae7c5643e79777b21078fffbd1, user_id=b8601df2b86c411e88a98b182aa1ed44, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:37.456800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2224d-7cad-49a2-b592-f9280eb1f032 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:37.472780 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:37.477467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 807/1634] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:37 2022] PUT /identity/v3/projects/b6a333ae7c5643e79777b21078fffbd1/users/b8601df2b86c411e88a98b182aa1ed44/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:37.488553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.489675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.490288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.502490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 828/1635] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 8 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:37.507440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d3843-7523-4527-906b-1bf4d6923dda None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.507440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d3843-7523-4527-906b-1bf4d6923dda None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.507440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d3843-7523-4527-906b-1bf4d6923dda None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.513422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 829/1636] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 8 13:46:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:46:37.515101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.516399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.518216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.549902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:37.552202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:37.552866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] MFA Rules not processed for user `b8601df2b86c411e88a98b182aa1ed44`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:37.554340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:37.686039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 830/1637] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:37.704110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 808/1638] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:46:37.814205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:37.874959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462167b-635f-464c-931b-3e3eb5b355d4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:37.879667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a388-26fb-432f-8156-664a10b8b228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:37.880458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a388-26fb-432f-8156-664a10b8b228 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:37.880773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a388-26fb-432f-8156-664a10b8b228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:37.881011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a388-26fb-432f-8156-664a10b8b228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:37.892496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a388-26fb-432f-8156-664a10b8b228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:37.893947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a388-26fb-432f-8156-664a10b8b228 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:37.907115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 831/1639] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:37.985920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:38.004442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012d77f-795b-4bea-8cb4-f66e357d5e6d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:38.009725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da55b7-6672-4118-887f-1c0e3beea2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:38.010907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da55b7-6672-4118-887f-1c0e3beea2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.010907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da55b7-6672-4118-887f-1c0e3beea2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.011152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da55b7-6672-4118-887f-1c0e3beea2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.034987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da55b7-6672-4118-887f-1c0e3beea2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:38.036787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da55b7-6672-4118-887f-1c0e3beea2d5 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:38.051183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 809/1640] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:38.077359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5966e-cc00-4a30-ac39-5952f3099129 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.077736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5966e-cc00-4a30-ac39-5952f3099129 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.078111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5966e-cc00-4a30-ac39-5952f3099129 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.080697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 832/1641] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 8 13:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:46:38.090085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.090085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.091103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.119587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:38.122150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:38.152348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 810/1642] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:38.192966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.193257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.193595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.244328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] MFA Rules not processed for user `8fd00cf03b884d8999591ae4db0c1bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:38.245615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:38.274497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:38.380714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 833/1643] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:38.381817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:38.408305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098da7c1-473a-4c40-a385-e475e8a7a0df None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:38.419418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bb19e-52ef-448e-b444-8ca00f97132e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:38.419640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bb19e-52ef-448e-b444-8ca00f97132e service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.420106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bb19e-52ef-448e-b444-8ca00f97132e service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.420451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bb19e-52ef-448e-b444-8ca00f97132e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.440176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bb19e-52ef-448e-b444-8ca00f97132e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:38.441707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bb19e-52ef-448e-b444-8ca00f97132e service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:38.445221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685c3b3-8e4c-47ff-a979-d063d78f1103 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:38.449737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:38.459794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:38.461690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.462169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.462630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] PATH_INFO: `/v3/users/0b277a221f4042fcae368507f572171b` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.463740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 834/1644] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:38.465458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.465812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.466156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.466873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b277a221f4042fcae368507f572171b)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:38.468144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: WARNING py.warnings [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:46:38.468144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: warnings.warn(msg) Jun 08 13:46:38.468144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: Jun 08 13:46:38.472513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:38.498752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] MFA Rules not processed for user `8fd00cf03b884d8999591ae4db0c1bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:38.500045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:38.511397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 835/1645] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:38.528955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:38.592499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e89a4-db62-4b91-b57d-656bc95fa91d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:38.896161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:38.896161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.896161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.896161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.899777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:38.899777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:38.899777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 836/1646] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:38.899777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:38.899777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358151d-db9d-4238-9df2-462993b62cea service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:38.901515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:38.901515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:38.901515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:38.901515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] PATH_INFO: `/v3/users/e6a2825f34ec4adf90cac06ec981bc42` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:38.902753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a2825f34ec4adf90cac06ec981bc42)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:38.902753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:38.969651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b277a221f4042fcae368507f572171b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:38.974070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:39.062126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b277a221f4042fcae368507f572171b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.073084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b277a221f4042fcae368507f572171b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.073084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b277a221f4042fcae368507f572171b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.084506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b277a221f4042fcae368507f572171b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.128481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 811/1647] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:38 2022] DELETE /identity/v3/users/0b277a221f4042fcae368507f572171b => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:39.129760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:39.133677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.179298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a2825f34ec4adf90cac06ec981bc42'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.181125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a2825f34ec4adf90cac06ec981bc42'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.220380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5af0-0f91-4e30-adb9-23bdc6a8a686 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:39.226245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:39.227834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.228242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.228621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] PATH_INFO: `/v3/users/16de1f8ed11f478bade53ff22e9ba062` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.230040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16de1f8ed11f478bade53ff22e9ba062)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:39.232284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:39.301877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a2825f34ec4adf90cac06ec981bc42'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.302777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a2825f34ec4adf90cac06ec981bc42'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.317343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ddba5ad6-c2c4-4bfc-bc89-1ad8d8f329cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a2825f34ec4adf90cac06ec981bc42'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.348084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 837/1648] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:38 2022] DELETE /identity/v3/users/e6a2825f34ec4adf90cac06ec981bc42 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:39.349638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba55e8-cc6f-4a8c-aee0-f252e65ddb61 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.350109 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba55e8-cc6f-4a8c-aee0-f252e65ddb61 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.350509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba55e8-cc6f-4a8c-aee0-f252e65ddb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.373659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-87ba55e8-cc6f-4a8c-aee0-f252e65ddb61 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:39.375519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-87ba55e8-cc6f-4a8c-aee0-f252e65ddb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.480769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16de1f8ed11f478bade53ff22e9ba062'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.490449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 838/1649] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:39.495465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7630c-e41e-4d83-9196-1a7cf7cd745c None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.495761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7630c-e41e-4d83-9196-1a7cf7cd745c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.496045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7630c-e41e-4d83-9196-1a7cf7cd745c None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.501331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 839/1650] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 8 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:46:39.501331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c0e48-7a53-48e7-96a8-d42766715344 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.501331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c0e48-7a53-48e7-96a8-d42766715344 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.501331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c0e48-7a53-48e7-96a8-d42766715344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.522724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-923c0e48-7a53-48e7-96a8-d42766715344 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:39.525598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-923c0e48-7a53-48e7-96a8-d42766715344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.534875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 840/1651] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:39.537056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.537541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.537922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.553206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16de1f8ed11f478bade53ff22e9ba062'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.554129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16de1f8ed11f478bade53ff22e9ba062'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.555171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16de1f8ed11f478bade53ff22e9ba062'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.575258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16de1f8ed11f478bade53ff22e9ba062'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:39.588777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:39.590239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.626923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 812/1652] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:39 2022] DELETE /identity/v3/users/16de1f8ed11f478bade53ff22e9ba062 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:39.628256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:39.629734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.644902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:39.679476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 841/1653] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:39.686535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:39.687936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.712169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae74c6-deb9-432c-8d60-1c6a14e55e5b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:39.716805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:39.717476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.717892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.718291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.720941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.737379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24fc56-ab70-4c9d-9480-30c817846e86 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:39.741348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:39.742024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.749839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.749839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.749839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.805942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:39.808080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921e69-b1e5-4c2e-a692-bef3fa28a018 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:39.821985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 842/1654] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:39.824391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.824893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.825307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.860484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:39.862108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:39.869923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:39.871389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:39.879082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 843/1655] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:39.881949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:39.888692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 813/1656] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:39.896137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e495e-7908-4c35-85a6-839eb4037410 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:39.902740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933eb11-f3d3-4063-8439-be6753e13424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:39.903538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933eb11-f3d3-4063-8439-be6753e13424 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:39.903925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933eb11-f3d3-4063-8439-be6753e13424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:39.904445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933eb11-f3d3-4063-8439-be6753e13424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:39.913705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933eb11-f3d3-4063-8439-be6753e13424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:39.915588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933eb11-f3d3-4063-8439-be6753e13424 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:39.928349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 844/1657] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:40.028905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:40.043216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf1740-b8d5-405d-a22e-847f17c82d12 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:40.056862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4301-4324-447f-aeb8-4079f72ea232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:40.057561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4301-4324-447f-aeb8-4079f72ea232 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:40.057879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4301-4324-447f-aeb8-4079f72ea232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:40.058169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4301-4324-447f-aeb8-4079f72ea232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:40.099329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4301-4324-447f-aeb8-4079f72ea232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:40.102560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4301-4324-447f-aeb8-4079f72ea232 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:40.120165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 814/1658] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:40.518182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:41.042562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c3f6-794c-4f6f-8026-2c58a81b8951 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.043047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c3f6-794c-4f6f-8026-2c58a81b8951 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.043289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c3f6-794c-4f6f-8026-2c58a81b8951 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.046899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 845/1659] 10.222.0.55 () {54 vars in 960 bytes} [Wed Jun 8 13:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:46:41.057797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.058772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.059378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.112251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42c3f6-794c-4f6f-8026-2c58a81b8951 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:41.114963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6d42c3f6-794c-4f6f-8026-2c58a81b8951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:41.136340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:41.137259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42c3f6-794c-4f6f-8026-2c58a81b8951 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:41.138906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:41.146602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:41.148437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.149006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.149716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] PATH_INFO: `/v3/projects/4613903d92f44ca284ebffce3961204d` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.151527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4613903d92f44ca284ebffce3961204d)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:41.157178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: WARNING py.warnings [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:46:41.157178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: warnings.warn(msg) Jun 08 13:46:41.157178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: Jun 08 13:46:41.159343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:41.392483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4613903d92f44ca284ebffce3961204d', 'request_id': 'req-8782d0dd-a616-4c74-91a7-ea2664df20fc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:41.406897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 815/1660] 10.222.0.55 () {58 vars in 1057 bytes} [Wed Jun 8 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:41.410862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:41.430611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9c4c3-c083-4339-be88-c4f316349fda None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:41.497735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4613903d92f44ca284ebffce3961204d', 'request_id': 'req-8782d0dd-a616-4c74-91a7-ea2664df20fc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:41.504735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4613903d92f44ca284ebffce3961204d', 'request_id': 'req-8782d0dd-a616-4c74-91a7-ea2664df20fc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:41.553764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] The token cache is being invalidate because project 4613903d92f44ca284ebffce3961204d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:41.556178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:41.557172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8782d0dd-a616-4c74-91a7-ea2664df20fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:41.560337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 846/1661] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:41 2022] DELETE /identity/v3/projects/4613903d92f44ca284ebffce3961204d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:41.566085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.566765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.567986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.597156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:41.599849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.599921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.600170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.605420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:41.614743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:41.625822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:41.634093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:41.635961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482b58a-f576-4cb4-8b90-19a34d570c15 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:41.651460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 816/1662] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:41.707117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:41.780541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 847/1663] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:41.787240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.787771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.788013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.833845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:41.839728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:41.876745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:41.877749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 817/1664] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:41.899183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092ccb-3e22-4cc1-9c8e-e5e15324a9a0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:41.910715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:41.911418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.911848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.911947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.912722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:41.913027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:41.921271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:41.961046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 848/1665] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:41.961389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:41.972851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e04c22-517e-4640-9b7c-422823dec40d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:41.978837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:41.979733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:41.980695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:41.980933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:41.981641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:41.983727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:42.121600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:42.129519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:42.149081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 818/1666] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:41 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:46:42.150516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:42.154027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:42.186615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799164d-448e-4021-8566-a6b20d7f5921 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:42.295098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b9a1-3fab-4adf-924a-c419d7589f81 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:42.303948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:42.313087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:42.313544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:42.314002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] PATH_INFO: `/v3/projects/8ed663d9fbec493680ccb284f19cf681` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:42.314932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:42.315923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:42.316221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed663d9fbec493680ccb284f19cf681)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:42.318372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:42.318766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] PATH_INFO: `/v3/projects/de2efde7c7f640b88acb575ea7fd50b8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:42.319627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:42.320762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2efde7c7f640b88acb575ea7fd50b8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:42.326955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:42.487733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed663d9fbec493680ccb284f19cf681', 'request_id': 'req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.510041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed663d9fbec493680ccb284f19cf681', 'request_id': 'req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.576799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2efde7c7f640b88acb575ea7fd50b8', 'request_id': 'req-a89a49b3-f652-4e59-95b1-b1624fc2282a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.593403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed663d9fbec493680ccb284f19cf681', 'request_id': 'req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.614323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] The token cache is being invalidate because project 8ed663d9fbec493680ccb284f19cf681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:42.615170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.617983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.621815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 819/1667] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:42 2022] DELETE /identity/v3/projects/8ed663d9fbec493680ccb284f19cf681 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:42.626841 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:42.632321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:42.686448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2efde7c7f640b88acb575ea7fd50b8', 'request_id': 'req-a89a49b3-f652-4e59-95b1-b1624fc2282a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.691092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:42.693220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2efde7c7f640b88acb575ea7fd50b8', 'request_id': 'req-a89a49b3-f652-4e59-95b1-b1624fc2282a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.742829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] The token cache is being invalidate because project de2efde7c7f640b88acb575ea7fd50b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:42.744219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.746294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:42.749337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 849/1668] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:42 2022] DELETE /identity/v3/projects/de2efde7c7f640b88acb575ea7fd50b8 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:42.754101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:42.756955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:42.768554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14a4fc-a01d-4580-93fd-dc64f40e5c97 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:42.892047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a49b3-f652-4e59-95b1-b1624fc2282a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:42.904962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:42.905727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:42.906014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:42.906289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] PATH_INFO: `/v3/users/525580a1705b4e868a2c091222a52a4a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:42.907606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525580a1705b4e868a2c091222a52a4a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:42.909589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:42.936820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:42.937531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:42.937820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:42.938101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:42.938807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:42.941699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:43.098428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 820/1669] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:42 2022] POST /identity/v3/users => generated 287 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:43.103178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:43.109443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:43.151238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608a89-2aed-40cf-9d2b-6525fce3728a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:43.169060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525580a1705b4e868a2c091222a52a4a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.169749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525580a1705b4e868a2c091222a52a4a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.170583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:43.171729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:43.172924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:43.173402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] PATH_INFO: `/v3/users/b8601df2b86c411e88a98b182aa1ed44` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:43.178975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8601df2b86c411e88a98b182aa1ed44)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:43.191890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:43.355591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:43.362631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525580a1705b4e868a2c091222a52a4a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.362631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525580a1705b4e868a2c091222a52a4a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.378869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525580a1705b4e868a2c091222a52a4a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.431214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 850/1670] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:42 2022] DELETE /identity/v3/users/525580a1705b4e868a2c091222a52a4a => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:43.432813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:43.439067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:43.501157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:43.556671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8601df2b86c411e88a98b182aa1ed44'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.662101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49a88-605b-4529-a780-d7913d1843f0 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:43.671384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:43.672620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:43.672973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:43.673370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:43.674538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:43.677412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:43.693067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8601df2b86c411e88a98b182aa1ed44'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.693067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8601df2b86c411e88a98b182aa1ed44'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.693067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8601df2b86c411e88a98b182aa1ed44'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.702274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8601df2b86c411e88a98b182aa1ed44'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:43.708743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 851/1671] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:43.725120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:43.733712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:43.745464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 821/1672] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:43 2022] DELETE /identity/v3/users/b8601df2b86c411e88a98b182aa1ed44 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:43.779137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb9992-097e-4247-84bd-0c3871119393 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:44.005658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d19ca7-df1c-4728-8eb9-e3060ac152ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:44.006375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d19ca7-df1c-4728-8eb9-e3060ac152ef admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:44.006696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d19ca7-df1c-4728-8eb9-e3060ac152ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:44.006921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d19ca7-df1c-4728-8eb9-e3060ac152ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:44.009862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d19ca7-df1c-4728-8eb9-e3060ac152ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:44.009862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d19ca7-df1c-4728-8eb9-e3060ac152ef admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:44.042214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 852/1673] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:44.042393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:44.058691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3271-4179-4129-a2ce-7daaace0de41 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:44.066861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:44.067789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:44.068091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:44.068368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] PATH_INFO: `/v3/projects/ff408f035c50479bbc9e2420e90e7e60/users/87c4a5f0204a488dbf3fa53358e7e3ba/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:44.140576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff408f035c50479bbc9e2420e90e7e60, user_id=87c4a5f0204a488dbf3fa53358e7e3ba, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:44.147402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:44.261139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 822/1674] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:44 2022] PUT /identity/v3/projects/ff408f035c50479bbc9e2420e90e7e60/users/87c4a5f0204a488dbf3fa53358e7e3ba/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:44.277748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:44.278200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:44.278402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:44.338768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] MFA Rules not processed for user `87c4a5f0204a488dbf3fa53358e7e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:44.340190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:44.437426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 853/1675] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:44.438810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:44.589257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71989-5bee-4d81-96ac-24803d4e9f25 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:44.610023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:44.610744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:44.611028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:44.611315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:44.612124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:44.614141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:44.775970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 823/1676] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:44 2022] POST /identity/v3/projects => generated 371 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:44.781467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:44.801838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783d33f-4723-41b8-9457-f444c6ece89c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:44.990571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:44.994258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:44.994814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:44.996349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:44.997177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:45.001886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:45.141275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 854/1677] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:44 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:46:45.142740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:45.164676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6efba9-4c02-48ad-bbd0-ed4b6ea5f82b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:45.180794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:45.181640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:45.183005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:45.183409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:45.185615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:45.190651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:45.220314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 824/1678] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:45.220728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:45.233980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c83c-82d4-4be9-aa2f-2d8f92942aeb admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:45.248014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:45.249174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:45.249457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:45.251309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] PATH_INFO: `/v3/projects/79a12bebf039418ba09493b35a961581/users/fb141e85dac440d08b999d187bd4826c/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:45.283890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a12bebf039418ba09493b35a961581, user_id=fb141e85dac440d08b999d187bd4826c, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:45.289938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:45.448749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 855/1679] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:45 2022] PUT /identity/v3/projects/79a12bebf039418ba09493b35a961581/users/fb141e85dac440d08b999d187bd4826c/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:46:45.452434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:45.470665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8d74-090e-4574-ac3c-b3bf2b348ad3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:45.522401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:45.525974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:45.700912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:45.704592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:45.706108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:45.711399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cc95e-7b83-47a4-9009-5bf05a9e652a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:45.712081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:45.713105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:45.717045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:45.721606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:45.722523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:45.724382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:45.724382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] PATH_INFO: `/v3/projects/b6a333ae7c5643e79777b21078fffbd1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:45.724552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a333ae7c5643e79777b21078fffbd1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:45.731137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:45.749706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:45.774589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 825/1680] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:45.778940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:45.831801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff861-4ae1-449b-a651-f4baeb062574 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:45.859827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae94e0-4436-41e8-8348-746337c79860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:45.861096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae94e0-4436-41e8-8348-746337c79860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:45.861439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae94e0-4436-41e8-8348-746337c79860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:45.861658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae94e0-4436-41e8-8348-746337c79860 admin admin] PATH_INFO: `/v3/projects/79a12bebf039418ba09493b35a961581/users/fb141e85dac440d08b999d187bd4826c/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:45.869002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae94e0-4436-41e8-8348-746337c79860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a12bebf039418ba09493b35a961581, user_id=fb141e85dac440d08b999d187bd4826c, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:45.878323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae94e0-4436-41e8-8348-746337c79860 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:45.912669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 826/1681] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:45 2022] PUT /identity/v3/projects/79a12bebf039418ba09493b35a961581/users/fb141e85dac440d08b999d187bd4826c/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:45.918184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:45.918477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:45.918765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:45.942696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:45.944027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a333ae7c5643e79777b21078fffbd1', 'request_id': 'req-6058dfd0-ed2e-4433-b195-a47d685e12a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:45.967697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] MFA Rules not processed for user `fb141e85dac440d08b999d187bd4826c`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:45.969017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:46.056391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a333ae7c5643e79777b21078fffbd1', 'request_id': 'req-6058dfd0-ed2e-4433-b195-a47d685e12a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:46.064084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a333ae7c5643e79777b21078fffbd1', 'request_id': 'req-6058dfd0-ed2e-4433-b195-a47d685e12a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:46.101855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] The token cache is being invalidate because project b6a333ae7c5643e79777b21078fffbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:46.104285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:46.104285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6058dfd0-ed2e-4433-b195-a47d685e12a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:46.115360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 856/1682] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:45 2022] DELETE /identity/v3/projects/b6a333ae7c5643e79777b21078fffbd1 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:46:46.120007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13221-9593-4ec6-8463-80f935607cab None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:46.120371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13221-9593-4ec6-8463-80f935607cab None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:46.120653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13221-9593-4ec6-8463-80f935607cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:46.132095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 827/1683] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:46:46.149669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-80e13221-9593-4ec6-8463-80f935607cab None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:46.151145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-80e13221-9593-4ec6-8463-80f935607cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:46.154923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:46.156182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:46.289998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120c5ce-8539-4ae5-bf64-3eb5dfae1912 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:46.300834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:46.301516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:46.301802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:46.311241 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 857/1684] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:46.312649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:46.313937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:46.314222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:46.314496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:46.317317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:46.364420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:46.365564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:46.386078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:46.390113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:46.411067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 858/1685] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:46.415302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:46.420033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 828/1686] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:46.433502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217044da-cad8-4f9b-b211-9b5e322c6074 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:46.447164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:46.447905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:46.448939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:46.449224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:46.454716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:46.455056 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:46.457009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:46.488495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 859/1687] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:46:46.489665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:46.508283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f939c0-359a-4456-9e21-044fa1b536e3 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:46.517082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:46.517764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:46.518052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:46.518335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:46.519732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:46.525711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:46.702718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 829/1688] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:46 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:46.706693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:46.727416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613c99-959b-4683-bdf2-02536759bd0a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:46.837515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:46.838278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:46.838566 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:46.839075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:46.839682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:46.841865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:46.956434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 860/1689] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:46 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:46.964263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:46.985055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ce11b-21fa-482c-89ae-b3cd5d578f78 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:47.013176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:47.014452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.015714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.017104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.018196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:47.025748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:47.027776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:47.033938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.050269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 830/1690] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:47.059300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:47.076608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f3a2d-1537-4f10-882d-01bfd677b665 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:47.095160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:47.096075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.097184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.097476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] PATH_INFO: `/v3/projects/f28542a2d3394f85b7717788deaf94ae` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.104793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28542a2d3394f85b7717788deaf94ae)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:47.107054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61827c3-fa70-4b7e-ba8d-d6c5e8207c15 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:47.110557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:47.130963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:47.134996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.135911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.136234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.139400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:47.142019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:47.181131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 831/1691] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:46:47.209186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:47.258344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3937-8e66-43bb-a69d-ecabf3aa34b8 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:47.286181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16f696-3e56-4278-846d-7135526370c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:47.287414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f696-3e56-4278-846d-7135526370c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.288180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f696-3e56-4278-846d-7135526370c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.288876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f696-3e56-4278-846d-7135526370c7 admin admin] PATH_INFO: `/v3/projects/17912dc926e64823b36fb3d47375972a/users/375552a2121144209ffcd2c1e20c7705/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.325113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16f696-3e56-4278-846d-7135526370c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17912dc926e64823b36fb3d47375972a, user_id=375552a2121144209ffcd2c1e20c7705, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:47.326117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28542a2d3394f85b7717788deaf94ae', 'request_id': 'req-2fd8f912-8285-4118-9f4f-ae5f16645168'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:47.331716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16f696-3e56-4278-846d-7135526370c7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:47.401948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28542a2d3394f85b7717788deaf94ae', 'request_id': 'req-2fd8f912-8285-4118-9f4f-ae5f16645168'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:47.418031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28542a2d3394f85b7717788deaf94ae', 'request_id': 'req-2fd8f912-8285-4118-9f4f-ae5f16645168'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:47.442665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] The token cache is being invalidate because project f28542a2d3394f85b7717788deaf94ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:47.444693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:47.450171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2fd8f912-8285-4118-9f4f-ae5f16645168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:47.452837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 861/1692] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:47 2022] DELETE /identity/v3/projects/f28542a2d3394f85b7717788deaf94ae => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:47.457235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a6bd-203c-4dac-8a29-722855eec101 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.457790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a6bd-203c-4dac-8a29-722855eec101 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.458409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a6bd-203c-4dac-8a29-722855eec101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.460629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 832/1693] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:47 2022] PUT /identity/v3/projects/17912dc926e64823b36fb3d47375972a/users/375552a2121144209ffcd2c1e20c7705/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:47.466725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd38b4-ecdc-4669-b12c-738450cbd5ac None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.467023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd38b4-ecdc-4669-b12c-738450cbd5ac None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.467304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd38b4-ecdc-4669-b12c-738450cbd5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.503594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9675a6bd-203c-4dac-8a29-722855eec101 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:47.508752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9675a6bd-203c-4dac-8a29-722855eec101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.537005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-85bd38b4-ecdc-4669-b12c-738450cbd5ac None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:47.538453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-85bd38b4-ecdc-4669-b12c-738450cbd5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.624827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 862/1694] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:47.647421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 833/1695] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:47.649111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.650060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.650060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.671965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86883d23-b771-4d56-8771-d32c7dc9badc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.671965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86883d23-b771-4d56-8771-d32c7dc9badc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.671965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86883d23-b771-4d56-8771-d32c7dc9badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.705285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-86883d23-b771-4d56-8771-d32c7dc9badc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:47.706697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-86883d23-b771-4d56-8771-d32c7dc9badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.723962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] MFA Rules not processed for user `cc438414709747599fba278ea9b6fecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:47.725287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.726097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 863/1696] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:47.727637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.728750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.729267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.777876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:47.779310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.805700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 864/1697] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:47.806951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:47.835071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:47.920977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 834/1698] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:47.924088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:47.954133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ac751-27b5-4acc-809b-9b26d25b0712 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:47.969706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:47.970369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.970762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.971200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:47.973960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:47.979103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:47.979103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:47.980943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd054-5fb8-4ad1-9470-6fa98f5980c5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:47.993552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:47.994407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:47.994857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:47.995460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.008274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 835/1699] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:48.010488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:48.016708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:48.017861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:48.020692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:48.046470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 865/1700] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:48.050682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:48.051740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:48.082140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598b38-3338-4e10-ac48-0a7d24aab160 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:48.094601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:48.096740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:48.097315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:48.099098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] PATH_INFO: `/v3/users/87c4a5f0204a488dbf3fa53358e7e3ba` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.101768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c4a5f0204a488dbf3fa53358e7e3ba)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:48.105381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:48.180682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5caad-7e3a-4fec-9a68-e22967071371 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:48.187519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:48.188665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:48.189123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:48.189566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.204108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:48.208627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:48.222579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 836/1701] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:48.223768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:48.238536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a14dab-b69e-4364-b1cd-6448f4559bbf service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:48.245428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:48.246557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:48.247053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:48.260800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.262435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:48.267020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:48.283631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:48.466679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 837/1702] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:48 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:48.467860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:48.474701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:48.474824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c4a5f0204a488dbf3fa53358e7e3ba'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:48.475483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c4a5f0204a488dbf3fa53358e7e3ba'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:48.570700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c4a5f0204a488dbf3fa53358e7e3ba'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:48.571718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c4a5f0204a488dbf3fa53358e7e3ba'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:48.582420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c4a5f0204a488dbf3fa53358e7e3ba'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:48.615664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897188-11ca-4690-9bfe-2bfdc41dae44 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:48.618958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 866/1703] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:48 2022] DELETE /identity/v3/users/87c4a5f0204a488dbf3fa53358e7e3ba => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:48.620080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:48.623128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:48.675276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:48.778277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:48.779009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:48.779296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:48.779628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.783524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:48.791554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc0b74-42bf-4d7b-959c-f8f89c7f5139 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:48.805346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:48.806062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:48.806755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:48.807756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.808541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:48.813573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:48.886082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:48.888497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0044a3-0642-4c52-8035-e69c7f7f6b05 service swift] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:48.899607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 838/1704] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:46:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:46:48.917711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:48.918084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:48.918472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:48.967705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 867/1705] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:48 2022] POST /identity/v3/users => generated 289 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:48.973099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:49.026401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2a894-70fc-4459-bfb1-87817a2be7e4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:49.042574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:49.044744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:49.056654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:49.057451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:49.057748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:49.058126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:49.064230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:49.069824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:49.085926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 839/1706] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:49.121837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 868/1707] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:49.124241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:49.150140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:49.152583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:49.168381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab69b38-ee9b-4e34-8b65-89b70c3f4e5c None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:49.176850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:49.177558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:49.177852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:49.183172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:49.183172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:49.196252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:49.246987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 840/1708] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:49.249658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:49.300512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318caa30-f1ac-4262-9f14-159a1889cd0a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:49.321554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:49.329742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a44e7-99f0-41ac-9849-d15d83202536 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:49.331206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:49.331586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:49.331881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] PATH_INFO: `/v3/projects/3dfe97aced0a449fb63fabaf50026cde/users/d9e380024c3d400ba01396660f6561ef/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:49.347287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c4ffb-4935-4261-833c-e62943707275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:49.353315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c4ffb-4935-4261-833c-e62943707275 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:49.353315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c4ffb-4935-4261-833c-e62943707275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:49.353315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c4ffb-4935-4261-833c-e62943707275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:49.372143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c4ffb-4935-4261-833c-e62943707275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:49.373975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c4ffb-4935-4261-833c-e62943707275 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:49.404814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfe97aced0a449fb63fabaf50026cde, user_id=d9e380024c3d400ba01396660f6561ef, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:49.405687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 869/1709] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:46:49.415292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:49.564129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 841/1710] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:49 2022] PUT /identity/v3/projects/3dfe97aced0a449fb63fabaf50026cde/users/d9e380024c3d400ba01396660f6561ef/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:49.578551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:49.579604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:49.579901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:49.667026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] MFA Rules not processed for user `d9e380024c3d400ba01396660f6561ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:49.668419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:49.834699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:49.924479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:49.942483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 870/1711] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:50.172008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16b5e-34ff-4dd0-b834-62d1f7eff2f1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:50.194164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdade9-cb81-4120-b453-d3f41db1d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:50.196502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdade9-cb81-4120-b453-d3f41db1d91c admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:50.196786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdade9-cb81-4120-b453-d3f41db1d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:50.197070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdade9-cb81-4120-b453-d3f41db1d91c admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:50.204091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdade9-cb81-4120-b453-d3f41db1d91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:50.206517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:50.211073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdade9-cb81-4120-b453-d3f41db1d91c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:50.652178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 842/1712] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:49 2022] POST /identity/v3/projects => generated 375 bytes in 728 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:50.658686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:50.679809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fe65b-7309-4634-a2cb-2948eaa1d70f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:50.821129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:50.822405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:50.822962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:50.823529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:50.829301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:50.831942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:50.950848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:50.951134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:50.951790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:50.981120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 871/1713] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:50 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:50.985195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.001645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:51.009318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:51.010206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f151221-d6dd-4acc-a8aa-7b16a9c4a87f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:51.025797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:51.025797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.025797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.025797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.026093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:51.028510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:51.054160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 872/1714] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:46:51.067420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.117301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca88a8-aa31-4b65-a2a1-dd078553862d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:51.152499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:51.153428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.153691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.153965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] PATH_INFO: `/v3/projects/553909ac5166487a9cf26f64561b7ee3/users/de510ee8bd974af582867f90625ffa31/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.185634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 843/1715] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Jun 8 13:46:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:46:51.218482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=553909ac5166487a9cf26f64561b7ee3, user_id=de510ee8bd974af582867f90625ffa31, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:51.221213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:51.245269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.258052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ef41-e232-408a-a364-3bdf6d9cd45b None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:51.271399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:51.272349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.274816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.275355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.309252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:51.313958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:51.323258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 873/1716] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:51 2022] PUT /identity/v3/projects/553909ac5166487a9cf26f64561b7ee3/users/de510ee8bd974af582867f90625ffa31/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:51.324373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.330665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 844/1717] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:51.331832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.335024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:51.367256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752f75-11ff-4883-bc5b-0a06f219c001 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:51.485973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef41587-169f-419f-a244-2ce28fda9a3a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:51.495092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:51.508628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.509017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.517352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.517352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:51.518048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:51.518132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:51.518207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:51.518207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.518207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.518207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] PATH_INFO: `/v3/users/3aabc0c440bb4db09dd507b661a278fc` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.523633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aabc0c440bb4db09dd507b661a278fc)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:51.526443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:51.526651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 874/1718] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:51.533214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.561926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee932aaf-4bd6-4168-9b19-643ac114af77 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:51.569522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03bd15-5896-4b14-a7c3-9f56febae42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:51.571731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bd15-5896-4b14-a7c3-9f56febae42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.572066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bd15-5896-4b14-a7c3-9f56febae42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.572376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bd15-5896-4b14-a7c3-9f56febae42c admin admin] PATH_INFO: `/v3/projects/553909ac5166487a9cf26f64561b7ee3/users/de510ee8bd974af582867f90625ffa31/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.575589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03bd15-5896-4b14-a7c3-9f56febae42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=553909ac5166487a9cf26f64561b7ee3, user_id=de510ee8bd974af582867f90625ffa31, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:51.578587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03bd15-5896-4b14-a7c3-9f56febae42c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:51.615507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 875/1719] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:51 2022] PUT /identity/v3/projects/553909ac5166487a9cf26f64561b7ee3/users/de510ee8bd974af582867f90625ffa31/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:51.622260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:51.622260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:51.622260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:51.681151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] MFA Rules not processed for user `de510ee8bd974af582867f90625ffa31`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:51.689415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:51.856516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 876/1720] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:51.869699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:51.873424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:51.880556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aabc0c440bb4db09dd507b661a278fc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.000181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aabc0c440bb4db09dd507b661a278fc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.006749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aabc0c440bb4db09dd507b661a278fc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.006749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aabc0c440bb4db09dd507b661a278fc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.013839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3ac0cd10-0c6d-4459-afdd-11bd0817dc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aabc0c440bb4db09dd507b661a278fc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.083865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991df6e-0a9a-4001-8c55-3d7e557bc5ed None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:52.094519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:52.095205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:52.095490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:52.095778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:52.098303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:52.105507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 845/1721] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:51 2022] DELETE /identity/v3/users/3aabc0c440bb4db09dd507b661a278fc => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:52.115222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:52.115523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:52.115809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:52.185382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:52.190604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:52.222186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:52.235410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:52.250018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 877/1722] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:52.250905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:52.253190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:52.280595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:52.395624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 846/1723] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:52.495962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:52.497515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:52.501827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e27c18-60ca-4045-8010-53f9c45307cc service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:52.514025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:52.524631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:52.524914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:52.527282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] PATH_INFO: `/v3/projects/ff408f035c50479bbc9e2420e90e7e60` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:52.531239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff408f035c50479bbc9e2420e90e7e60)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:52.538437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:52.727992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919ed20-9b9c-4e9b-ac1e-7309550b9c87 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:52.750910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:52.752884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:52.753389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:52.754039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:52.793261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:52.796592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:52.801023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff408f035c50479bbc9e2420e90e7e60', 'request_id': 'req-1a7953b8-a3f6-4570-b697-205690a051a5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.824539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:52.861949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 847/1724] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:46:52.909204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff408f035c50479bbc9e2420e90e7e60', 'request_id': 'req-1a7953b8-a3f6-4570-b697-205690a051a5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:52.939278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff408f035c50479bbc9e2420e90e7e60', 'request_id': 'req-1a7953b8-a3f6-4570-b697-205690a051a5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.000373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] The token cache is being invalidate because project ff408f035c50479bbc9e2420e90e7e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:53.007910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.007910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1a7953b8-a3f6-4570-b697-205690a051a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.010718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 878/1725] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:52 2022] DELETE /identity/v3/projects/ff408f035c50479bbc9e2420e90e7e60 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:53.015517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:53.050614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9f82-5f6a-47e7-b312-16562eb89366 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:53.287100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:53.294354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:53.294354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:53.294354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] PATH_INFO: `/v3/users/fb141e85dac440d08b999d187bd4826c` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:53.295556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb141e85dac440d08b999d187bd4826c)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:53.299206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:53.374994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:53.375290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:53.375571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:53.466024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] MFA Rules not processed for user `375552a2121144209ffcd2c1e20c7705`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:53.492197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:53.665967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb141e85dac440d08b999d187bd4826c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.790519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb141e85dac440d08b999d187bd4826c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.791206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb141e85dac440d08b999d187bd4826c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.791994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb141e85dac440d08b999d187bd4826c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.805769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 879/1726] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:53.808768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-14ff04b7-36ab-4d01-9369-a78dad442cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb141e85dac440d08b999d187bd4826c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:53.810898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:53.818218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:53.879852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273262f9-ba13-47b7-94b1-dcb715cde763 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:53.880019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 848/1727] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:46:53 2022] DELETE /identity/v3/users/fb141e85dac440d08b999d187bd4826c => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:54.100275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:54.101117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:54.101474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:54.101665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:54.102364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:54.108362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:54.287864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:54.289800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:54.290476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:54.297887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:54.306620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 880/1728] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:53 2022] POST /identity/v3/projects => generated 373 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:54.310450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:54.312842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:54.348201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] MFA Rules not processed for user `1b970b89c20645d98da510e03a915fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:54.351597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:54.545336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 849/1729] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:54.557642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ecd1-b307-432b-b43f-5958d551f306 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:54.559868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:54.561980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:54.563505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:54.569152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:54.571588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:54.571840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:54.575160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:54.577053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:54.580426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:54.673060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 881/1730] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:54 2022] POST /identity/v3/users => generated 293 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:46:54.677083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:54.693958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be5a35-878e-4692-9d59-6c328a6ab9b2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:54.713033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:54.713814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:54.724510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:54.724908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:54.726530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:54.728077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:54.759382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 882/1731] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:54.761293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:54.766145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d8a28-a448-4b37-a486-17099da08560 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:54.777504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:54.778178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:54.787485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:54.787485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:54.792082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:54.794909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:54.798023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed308-d779-4881-8ef7-94bb920ae6f2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:54.822093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 850/1732] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:46:54.825565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:54.826716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:54.827002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:54.827280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] PATH_INFO: `/v3/projects/dfa393e46464434b918e13588b944e2f/users/117d2186666f4deeab84a4bc34d734d0/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:54.861310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa393e46464434b918e13588b944e2f, user_id=117d2186666f4deeab84a4bc34d734d0, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:54.868965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:54.976402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 883/1733] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:54 2022] PUT /identity/v3/projects/dfa393e46464434b918e13588b944e2f/users/117d2186666f4deeab84a4bc34d734d0/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:54.978870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:54.995576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ee274-0876-4a7f-aa7d-d251d7f282f2 service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:55.195281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:55.196915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:55.197204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:55.197482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:55.198382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:55.200442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:55.218073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 851/1734] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:55.222530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:55.248573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca108-e83c-4ca1-8b9b-383ae96525e5 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:55.260824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843d9c-f607-4f8b-9f5f-5737653df3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:55.261889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843d9c-f607-4f8b-9f5f-5737653df3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:55.262444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843d9c-f607-4f8b-9f5f-5737653df3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:55.262744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843d9c-f607-4f8b-9f5f-5737653df3fe admin admin] PATH_INFO: `/v3/projects/dfa393e46464434b918e13588b944e2f/users/117d2186666f4deeab84a4bc34d734d0/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:55.265053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843d9c-f607-4f8b-9f5f-5737653df3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa393e46464434b918e13588b944e2f, user_id=117d2186666f4deeab84a4bc34d734d0, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:55.273619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843d9c-f607-4f8b-9f5f-5737653df3fe admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:55.302172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 884/1735] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:55 2022] PUT /identity/v3/projects/dfa393e46464434b918e13588b944e2f/users/117d2186666f4deeab84a4bc34d734d0/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:56.120493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:56.123021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:56.164663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca827a-6b47-430b-9c3d-ffbf4d195bef admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:56.394438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:56.395384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:56.395963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:56.396358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] PATH_INFO: `/v3/projects/3285fa39ad9e469dae1191cc2a5fb130` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:56.399928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3285fa39ad9e469dae1191cc2a5fb130)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:56.402013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:56.628858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3285fa39ad9e469dae1191cc2a5fb130', 'request_id': 'req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:56.671988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3285fa39ad9e469dae1191cc2a5fb130', 'request_id': 'req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:56.679551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:56.720333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c3a45-6973-41b8-8a14-62eb8f01a0af None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:56.720782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c3a45-6973-41b8-8a14-62eb8f01a0af None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:56.720871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c3a45-6973-41b8-8a14-62eb8f01a0af None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:56.722515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 885/1736] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:46:56.747675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35140-c323-4926-a14a-8eacbbdeafd9 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:56.747675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35140-c323-4926-a14a-8eacbbdeafd9 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:56.747675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35140-c323-4926-a14a-8eacbbdeafd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:56.784663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-00a35140-c323-4926-a14a-8eacbbdeafd9 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:56.785928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-00a35140-c323-4926-a14a-8eacbbdeafd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:56.806955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3285fa39ad9e469dae1191cc2a5fb130', 'request_id': 'req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:56.858441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] The token cache is being invalidate because project 3285fa39ad9e469dae1191cc2a5fb130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:56.860774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:56.864551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:56.873093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 852/1737] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:56 2022] DELETE /identity/v3/projects/3285fa39ad9e469dae1191cc2a5fb130 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:46:56.875843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:56.887596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:56.998304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 886/1738] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:46:56.999937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.000454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.000928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.069097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e1e66-5ad6-4dcd-8c42-391e81e7d312 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.071326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:57.072865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.075917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.076998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.077432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.077601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] PATH_INFO: `/v3/projects/79a12bebf039418ba09493b35a961581` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.078788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a12bebf039418ba09493b35a961581)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:57.080764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:57.093145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:57.112936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 887/1739] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:57.112936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:57.112936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.144749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a7950-f082-4eea-ae7b-2cac541ba9db None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.159325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3ee2c-2b1f-46a7-b1f5-254a790e5884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.160014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3ee2c-2b1f-46a7-b1f5-254a790e5884 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.160432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3ee2c-2b1f-46a7-b1f5-254a790e5884 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.160667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3ee2c-2b1f-46a7-b1f5-254a790e5884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.181944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3ee2c-2b1f-46a7-b1f5-254a790e5884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:57.184496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3ee2c-2b1f-46a7-b1f5-254a790e5884 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:57.218742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 888/1740] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:46:57.223886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e727-ab2e-404c-aa8c-0f9d3c8da39e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.224319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e727-ab2e-404c-aa8c-0f9d3c8da39e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.224705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e727-ab2e-404c-aa8c-0f9d3c8da39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.253882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a12bebf039418ba09493b35a961581', 'request_id': 'req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:57.264376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a576e727-ab2e-404c-aa8c-0f9d3c8da39e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:57.265753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a576e727-ab2e-404c-aa8c-0f9d3c8da39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.286129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a12bebf039418ba09493b35a961581', 'request_id': 'req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:57.407504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a12bebf039418ba09493b35a961581', 'request_id': 'req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:57.427883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] The token cache is being invalidate because project 79a12bebf039418ba09493b35a961581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:46:57.431802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:57.434736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9e1eb55f-56ff-47e2-be04-a1ce5d5fd6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:46:57.441241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 853/1741] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:46:56 2022] DELETE /identity/v3/projects/79a12bebf039418ba09493b35a961581 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:57.443340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 889/1742] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:57.443524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.443880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.448381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.448510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1574-5304-4510-8047-16167da248de None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.448510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1574-5304-4510-8047-16167da248de None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.448510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1574-5304-4510-8047-16167da248de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.509213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] MFA Rules not processed for user `cc438414709747599fba278ea9b6fecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:57.512760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.513051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3c5a1574-5304-4510-8047-16167da248de None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:57.514363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3c5a1574-5304-4510-8047-16167da248de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.544716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 890/1743] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:57.546092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1574-5304-4510-8047-16167da248de None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:57.552943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3c5a1574-5304-4510-8047-16167da248de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.586993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1574-5304-4510-8047-16167da248de None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.606139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.607153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.608850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.609978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.610895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:57.612251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:57.615625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765e54-ae34-4217-bcb4-444ed979d912 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:57.648544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 891/1744] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:57.650343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f78099-18db-4821-853a-e4a674922893 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.650812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f78099-18db-4821-853a-e4a674922893 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.651294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f78099-18db-4821-853a-e4a674922893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.680331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 854/1745] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:57.681463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:57.701738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c5f78099-18db-4821-853a-e4a674922893 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:57.704476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c5f78099-18db-4821-853a-e4a674922893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:57.704852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279740d4-0f49-482a-b25e-4b0ef5bf52a9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.716222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.717669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.719710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.720209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.721801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:57.728006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:57.729471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 892/1746] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:57.734540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f78099-18db-4821-853a-e4a674922893 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:57.754145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f78099-18db-4821-853a-e4a674922893 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.765871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.766873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.767408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.768387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.771422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:46:57.771422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:57.773263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:57.825902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 893/1747] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:46:57.830205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:57.848572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 855/1748] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:57.854095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:57.876597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f45f5b-51e9-4c38-85fd-ece74dd62611 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.979688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.980427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.980919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.981341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.982961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:57.985126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:57.986546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1aef-1638-45d8-b15d-060a7e893450 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:57.994067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:57.995635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:57.996156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:57.996536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:57.997375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.000886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.099395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 894/1749] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:58.101602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.105427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 856/1750] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:57 2022] POST /identity/v3/users => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:58.111732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.150951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfedbfc-758d-4160-a666-6cf3a2dee93b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.311123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.311709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.311709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.312108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.317093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.318715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.371966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53f1a-0397-43c7-beac-fc8aa1c504ae admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.373644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 857/1751] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:58.385049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.394517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.395223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.395508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.395785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.396628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.398966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.430085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b9c2d-4256-4c96-8187-2aec69341457 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.458871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.459578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.459848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.460957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.461920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.469279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.501909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 858/1752] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:58.502828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.541461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 895/1753] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:58 2022] POST /identity/v3/users => generated 283 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:58.541644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82e8e1-a40d-4c1d-8fcd-ca1339d75ec9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.542654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.559056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44ea5a-8cb9-4ca1-b2bf-680fa0d13119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.559985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ea5a-8cb9-4ca1-b2bf-680fa0d13119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.560305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ea5a-8cb9-4ca1-b2bf-680fa0d13119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.560587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ea5a-8cb9-4ca1-b2bf-680fa0d13119 admin admin] PATH_INFO: `/v3/projects/219c612b2b1f4d05b27ae20fae1af603/users/c9d1d57852014ed3983a61eaa9263414/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.564955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1a31a-a688-404c-aba7-c0ab6bd7e5b2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.584807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.586800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.587285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.587749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.588765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.590831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.595972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44ea5a-8cb9-4ca1-b2bf-680fa0d13119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219c612b2b1f4d05b27ae20fae1af603, user_id=c9d1d57852014ed3983a61eaa9263414, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.610479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44ea5a-8cb9-4ca1-b2bf-680fa0d13119 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.611280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 896/1754] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:58.624725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.651621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eef7be-57a7-4758-b1c2-84d55a8d6d46 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.668965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.669915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.670349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.672024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.672024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.673520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.698057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 859/1755] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:58 2022] PUT /identity/v3/projects/219c612b2b1f4d05b27ae20fae1af603/users/c9d1d57852014ed3983a61eaa9263414/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:46:58.711138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.711138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.711138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.718493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 897/1756] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:58.721992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.739039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6338ad-db84-4554-9326-0eeefb7da579 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.764197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] MFA Rules not processed for user `c9d1d57852014ed3983a61eaa9263414`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:58.765857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:58.821242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e930ee-f2c0-4d82-9650-6f739e2d8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.824393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:58.825168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e930ee-f2c0-4d82-9650-6f739e2d8d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.825695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e930ee-f2c0-4d82-9650-6f739e2d8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.826255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e930ee-f2c0-4d82-9650-6f739e2d8d9b admin admin] PATH_INFO: `/v3/projects/e129857ba97d4b589f4881b66267c6d3/users/74df30c0066c45f69f66da7ddcd9b55f/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.859638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e930ee-f2c0-4d82-9650-6f739e2d8d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129857ba97d4b589f4881b66267c6d3, user_id=74df30c0066c45f69f66da7ddcd9b55f, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.862452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e930ee-f2c0-4d82-9650-6f739e2d8d9b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.915309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 860/1757] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:58.919439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:58.933248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a25be-fdb3-48e7-903c-cf972591b576 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:58.939042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:58.940132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.941343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.941705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:58.942555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:58.945337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:58.972443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 898/1758] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:46:58 2022] PUT /identity/v3/projects/e129857ba97d4b589f4881b66267c6d3/users/74df30c0066c45f69f66da7ddcd9b55f/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:46:58.983468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:58.983796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:58.984031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:59.034442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 861/1759] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:58 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:46:59.035390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:59.052107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] MFA Rules not processed for user `74df30c0066c45f69f66da7ddcd9b55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:59.054875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:59.223771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3113e8-3a78-409d-99f1-1030cbddcfa7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:59.243703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 899/1760] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:46:59.244937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:59.283256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9f2c9-ae24-41b0-ba5e-21fdf290f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:59.290229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:59.291950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f2c9-ae24-41b0-ba5e-21fdf290f665 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:59.291950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f2c9-ae24-41b0-ba5e-21fdf290f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:59.291950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f2c9-ae24-41b0-ba5e-21fdf290f665 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:59.292377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9f2c9-ae24-41b0-ba5e-21fdf290f665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:59.294611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9f2c9-ae24-41b0-ba5e-21fdf290f665 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:59.312837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7d21d-cf4c-424f-aad4-f0a52cf126de None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:59.332985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:59.341897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:59.343426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:59.343837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:59.345977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:59.353673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:59.431870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 862/1761] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:59 2022] POST /identity/v3/users => generated 309 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:59.434077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:59.434540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:59.434976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:59.558229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 900/1762] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:46:59 2022] POST /identity/v3/projects => generated 365 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:46:59.559493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:59.591531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] MFA Rules not processed for user `117d2186666f4deeab84a4bc34d734d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:46:59.603205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:59.773428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 863/1763] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:46:59.773428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:59.800349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15937d-b84b-473c-aeba-f8e18e9d925b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:59.848791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:59.851313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:59.851791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:59.853415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:59.857382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:59.859846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:59.886755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6ed8-341b-4195-b702-cd7c28dacbd6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:46:59.911754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:46:59.911973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 901/1764] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:46:59.911973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:46:59.912692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:46:59.913069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:46:59.913627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:46:59.914857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:46:59.918997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:46:59.928994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:46:59.953231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:00.036116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 864/1765] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:46:59 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:00.037350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:00.089963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4f41f-d3a5-48bd-921e-8321fe17abce admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.117042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158541d-f713-4203-ab7a-6230b3704e9c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.128961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.134964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.135516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.137833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] PATH_INFO: `/v3/projects/634e413470d34477a526191e71c69da6/users/30d425fedb49413d91cf8240a720b4e0/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.150974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:00.154984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.155271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.155559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.160919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.169907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:00.191418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e413470d34477a526191e71c69da6, user_id=30d425fedb49413d91cf8240a720b4e0, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.197795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.298451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 865/1766] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:00 2022] PUT /identity/v3/projects/634e413470d34477a526191e71c69da6/users/30d425fedb49413d91cf8240a720b4e0/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:00.299389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:00.426460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.429633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.472591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 902/1767] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:00.478434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:00.525286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2827eb-4f32-4e02-91f1-925786308568 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.590277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccae45-d176-4b46-89b7-2aae6c6e2b26 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.614319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.615122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.616794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.617322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.618126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.629912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.650601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 866/1768] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:00.651401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:00.653623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:00.729297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.730007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.730295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.730627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.732335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.738362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.755515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 903/1769] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:00.758378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4f47f-d4a5-47ed-b545-6f9a3341ff66 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.762961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:00.763112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.763736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.764028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.764366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.767666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:00.793092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2386e-c76a-4d91-88b3-1e8aa448675c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.813778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.815707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.816247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.816725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] PATH_INFO: `/v3/projects/71de1035b4bb46adba3e1df7c08e69a9/users/074fed2c09b34fd4b0dcd92ad7259fad/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.865899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.868742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.876891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71de1035b4bb46adba3e1df7c08e69a9, user_id=074fed2c09b34fd4b0dcd92ad7259fad, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.883548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 867/1770] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:00.884663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:00.884772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.898428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7b7bc-bfe4-4c0d-b8c3-32ddf94ab2db service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:00.905452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249b66-d831-4af9-b562-9fc4ee343579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:00.914560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249b66-d831-4af9-b562-9fc4ee343579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.914560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249b66-d831-4af9-b562-9fc4ee343579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.914560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249b66-d831-4af9-b562-9fc4ee343579 admin admin] PATH_INFO: `/v3/projects/634e413470d34477a526191e71c69da6/users/30d425fedb49413d91cf8240a720b4e0/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:00.916843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249b66-d831-4af9-b562-9fc4ee343579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e413470d34477a526191e71c69da6, user_id=30d425fedb49413d91cf8240a720b4e0, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:00.923480 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249b66-d831-4af9-b562-9fc4ee343579 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:00.937427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 868/1771] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:00 2022] PUT /identity/v3/projects/634e413470d34477a526191e71c69da6/users/30d425fedb49413d91cf8240a720b4e0/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:00.949671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:00.949968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:00.950339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:01.004811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] MFA Rules not processed for user `30d425fedb49413d91cf8240a720b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:01.011581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 904/1772] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:00 2022] PUT /identity/v3/projects/71de1035b4bb46adba3e1df7c08e69a9/users/074fed2c09b34fd4b0dcd92ad7259fad/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:01.012701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:01.015656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:01.314355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 869/1773] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:01.325629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2018965-4acb-4b51-9b74-beb9dfd90295 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:01.350315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:01.353140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:01.353517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:01.353695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:01.356533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:01.356533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:01.390581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:01.398953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 905/1774] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:01.416207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f647c-e54b-475a-9de9-108c67d0f487 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:01.447847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e273b-91e6-4d7c-aad2-305d4f1f276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:01.448826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e273b-91e6-4d7c-aad2-305d4f1f276d admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:01.449095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e273b-91e6-4d7c-aad2-305d4f1f276d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:01.449370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e273b-91e6-4d7c-aad2-305d4f1f276d admin admin] PATH_INFO: `/v3/projects/71de1035b4bb46adba3e1df7c08e69a9/users/074fed2c09b34fd4b0dcd92ad7259fad/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:01.451560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e273b-91e6-4d7c-aad2-305d4f1f276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71de1035b4bb46adba3e1df7c08e69a9, user_id=074fed2c09b34fd4b0dcd92ad7259fad, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:01.454322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e273b-91e6-4d7c-aad2-305d4f1f276d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:01.481013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:01.498155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 870/1775] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:01 2022] PUT /identity/v3/projects/71de1035b4bb46adba3e1df7c08e69a9/users/074fed2c09b34fd4b0dcd92ad7259fad/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:01.500112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5ee92-7dcc-412d-8bdd-81d8366f0b4c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:01.500227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5ee92-7dcc-412d-8bdd-81d8366f0b4c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:01.500531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5ee92-7dcc-412d-8bdd-81d8366f0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:01.555000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:01.566501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f9f5ee92-7dcc-412d-8bdd-81d8366f0b4c None None] MFA Rules not processed for user `074fed2c09b34fd4b0dcd92ad7259fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:01.568226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f9f5ee92-7dcc-412d-8bdd-81d8366f0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:01.713493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692320c-d6b7-41d2-aed8-ba2599ff93fa admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:01.750857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:01.872548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 871/1776] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:01.873847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6357d8-11ed-40b3-b120-a8850b7266bb None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:01.874359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6357d8-11ed-40b3-b120-a8850b7266bb None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:01.880264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5abd20-ab75-4f84-a6fd-2d3b14c6c886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:01.881385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5abd20-ab75-4f84-a6fd-2d3b14c6c886 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:01.882428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5abd20-ab75-4f84-a6fd-2d3b14c6c886 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:01.882863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5abd20-ab75-4f84-a6fd-2d3b14c6c886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:01.895737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6357d8-11ed-40b3-b120-a8850b7266bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:01.923017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-fa6357d8-11ed-40b3-b120-a8850b7266bb None None] MFA Rules not processed for user `1b970b89c20645d98da510e03a915fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:01.924330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fa6357d8-11ed-40b3-b120-a8850b7266bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:02.008857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 872/1777] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:02.010635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:02.010935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:02.011216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:02.073179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5abd20-ab75-4f84-a6fd-2d3b14c6c886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:02.075041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5abd20-ab75-4f84-a6fd-2d3b14c6c886 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:02.093794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] MFA Rules not processed for user `85e0d647620a407cbe03d83c86111f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:02.100227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:02.124825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 906/1778] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:01 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:02.257342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 873/1779] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:02.264085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:02.264430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:02.264718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:02.267301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:02.312334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] MFA Rules not processed for user `85e0d647620a407cbe03d83c86111f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:02.329034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:02.331360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46014404-e0b7-4faf-b70a-0f0d5b216683 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:02.357311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:02.357995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:02.358279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:02.358552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:02.376216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 907/1780] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:02.392818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:02.394278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:02.417253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 874/1781] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:02.669495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:02.770723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:02.786605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09134f3a-5e83-44f3-a695-d55d7ffcfb9f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:02.797495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:02.799060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:02.799520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:02.800010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:02.844875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:02.900003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:03.027776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:03.029979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:03.057845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 908/1782] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:03.063325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:03.064999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:03.127461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013421d1-ebce-4add-893c-0c3d6816303f service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:03.140088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:03.141850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.144204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.144495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] PATH_INFO: `/v3/users/c9d1d57852014ed3983a61eaa9263414` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.145946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d1d57852014ed3983a61eaa9263414)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:03.152712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:03.259829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a74c-6950-47fd-838f-557b7af49e6a service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:03.267595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:03.267595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.267595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.267595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.298332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:03.300013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:03.332635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 909/1783] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:03.334202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:03.363626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdee6e-867b-4142-8a9f-759ef7b43a90 service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:03.368795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a17a50-d69f-45b3-bd0c-b7650f2e55ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:03.369465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a17a50-d69f-45b3-bd0c-b7650f2e55ed service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.369817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a17a50-d69f-45b3-bd0c-b7650f2e55ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.370093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a17a50-d69f-45b3-bd0c-b7650f2e55ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.406622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d1d57852014ed3983a61eaa9263414'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:03.481768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a17a50-d69f-45b3-bd0c-b7650f2e55ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:03.483984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a17a50-d69f-45b3-bd0c-b7650f2e55ed service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:03.495848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 910/1784] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:03.497378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39278-e536-4853-b4a5-b5967456a88e None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.497733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39278-e536-4853-b4a5-b5967456a88e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.498074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39278-e536-4853-b4a5-b5967456a88e None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.503959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 911/1785] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 8 13:47:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:47:03.505367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.505721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.506067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.525940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:03.527312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:03.544631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d1d57852014ed3983a61eaa9263414'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:03.545514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d1d57852014ed3983a61eaa9263414'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:03.546315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d1d57852014ed3983a61eaa9263414'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:03.560354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-54f1b087-5fa1-4f7d-ad32-5010bf8df824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d1d57852014ed3983a61eaa9263414'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:03.605552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 875/1786] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:02 2022] DELETE /identity/v3/users/c9d1d57852014ed3983a61eaa9263414 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:03.609076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ed814-2341-40a4-9154-c46de375b86f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.609379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ed814-2341-40a4-9154-c46de375b86f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.610049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ed814-2341-40a4-9154-c46de375b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.637651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 912/1787] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:03.639828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-322ed814-2341-40a4-9154-c46de375b86f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:03.641167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-322ed814-2341-40a4-9154-c46de375b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:03.712942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:03.716154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:03.742180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836263fd-5185-4bba-adf7-955f34a60f05 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:03.763921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 876/1788] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:03.766351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:03.782071 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ed814-2341-40a4-9154-c46de375b86f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:03.783641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-322ed814-2341-40a4-9154-c46de375b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:03.847920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647da1-3a93-47f0-a5e3-62ac4d82f0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:03.848619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647da1-3a93-47f0-a5e3-62ac4d82f0ad service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.853077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647da1-3a93-47f0-a5e3-62ac4d82f0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.853577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647da1-3a93-47f0-a5e3-62ac4d82f0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.868736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647da1-3a93-47f0-a5e3-62ac4d82f0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:03.870293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647da1-3a93-47f0-a5e3-62ac4d82f0ad service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:03.884477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 913/1789] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:03.926197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ed814-2341-40a4-9154-c46de375b86f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:03.931403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:03.932081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:03.932391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:03.932669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:03.942159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:03.943702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:03.955254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 877/1790] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:04.023828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:04.964465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:05.158825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:05.159118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:05.159450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:05.179747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] MFA Rules not processed for user `85e0d647620a407cbe03d83c86111f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:05.181017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:05.188322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:05.196280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:05.198728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:05.221885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36085-341a-46d6-8ee5-c38436c60507 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:05.228388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:05.229742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:05.230026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:05.230303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] PATH_INFO: `/v3/projects/219c612b2b1f4d05b27ae20fae1af603` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:05.231525 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=219c612b2b1f4d05b27ae20fae1af603)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:05.234563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:05.260101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 914/1791] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:05.430160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219c612b2b1f4d05b27ae20fae1af603', 'request_id': 'req-30314101-99e6-45e4-8932-5986f8eb8e9f'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:05.450914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219c612b2b1f4d05b27ae20fae1af603', 'request_id': 'req-30314101-99e6-45e4-8932-5986f8eb8e9f'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:05.559101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219c612b2b1f4d05b27ae20fae1af603', 'request_id': 'req-30314101-99e6-45e4-8932-5986f8eb8e9f'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:05.576394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] The token cache is being invalidate because project 219c612b2b1f4d05b27ae20fae1af603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:05.576946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:05.577763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:05.580617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 878/1792] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:05 2022] DELETE /identity/v3/projects/219c612b2b1f4d05b27ae20fae1af603 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:05.584799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:05.604532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbd47-c602-4f73-861d-c7c1304c22e0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:05.727891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:05.729181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:05.729610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:05.729794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] PATH_INFO: `/v3/users/30d425fedb49413d91cf8240a720b4e0` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:05.731077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d425fedb49413d91cf8240a720b4e0)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:05.734907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:07.391429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d425fedb49413d91cf8240a720b4e0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:07.392496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d425fedb49413d91cf8240a720b4e0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:07.481432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d425fedb49413d91cf8240a720b4e0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:07.483575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d425fedb49413d91cf8240a720b4e0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:07.510205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-86829104-7538-45a1-bf36-66b0861ac7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d425fedb49413d91cf8240a720b4e0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:07.564094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 915/1793] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:05 2022] DELETE /identity/v3/users/30d425fedb49413d91cf8240a720b4e0 => generated 0 bytes in 1979 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:07.992929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:08.104847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:08.107334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:08.143164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314101-99e6-45e4-8932-5986f8eb8e9f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:08.222709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:08.222709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.222709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.222709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] PATH_INFO: `/v3/projects/634e413470d34477a526191e71c69da6` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.223039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=634e413470d34477a526191e71c69da6)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:08.223039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:08.355296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634e413470d34477a526191e71c69da6', 'request_id': 'req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:08.362640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634e413470d34477a526191e71c69da6', 'request_id': 'req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:08.472181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634e413470d34477a526191e71c69da6', 'request_id': 'req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:08.484771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] The token cache is being invalidate because project 634e413470d34477a526191e71c69da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:08.485091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:08.485733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f2d3d080-5ef5-4256-bc67-2b239ea0a65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:08.487288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 879/1794] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:08 2022] DELETE /identity/v3/projects/634e413470d34477a526191e71c69da6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:08.493103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.493590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.493696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.512980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:08.514201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:08.583610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 916/1795] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:08.593267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.593933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.593933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.613137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:08.614850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:08.629772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6957da-b27a-4a88-9a67-41fdcdb652ff None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:08.637801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:08.638097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:08.639128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:08.645275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.645275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.645275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] PATH_INFO: `/v3/users/74df30c0066c45f69f66da7ddcd9b55f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.645275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74df30c0066c45f69f66da7ddcd9b55f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:08.645275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:08.648739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 880/1796] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:08.653053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:08.664012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012b1ba-7733-4445-80ee-59fdf8953dcd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:08.668882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:08.669539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.669822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.670100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.670854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:08.671158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:08.672772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:08.686127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 881/1797] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:08.690372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:08.700546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363431f-e453-48f2-859d-2ca5b9c6c182 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:08.705133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:08.705826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.706112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.706389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.707060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:08.708950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:08.772281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:08.843278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 882/1798] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:08 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:08.847532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:08.932996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047c68-1a47-4c7d-a42c-d5dcdfb0fcea admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:08.939036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:08.940016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:08.940456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:08.941644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:08.942576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:08.944462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:08.969426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74df30c0066c45f69f66da7ddcd9b55f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:08.970184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74df30c0066c45f69f66da7ddcd9b55f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:09.028843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74df30c0066c45f69f66da7ddcd9b55f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:09.029486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74df30c0066c45f69f66da7ddcd9b55f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:09.040737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 883/1799] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:08 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:09.041866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:09.044137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:09.048338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-6c6b61a4-e88a-4385-b06b-96157afe8994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74df30c0066c45f69f66da7ddcd9b55f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:09.065569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534889c7-6a36-488c-ba2e-f3c56c8e2b38 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:09.075867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:09.076779 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.077317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.077595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.078324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:09.079997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:09.087870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 917/1800] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:08 2022] DELETE /identity/v3/users/74df30c0066c45f69f66da7ddcd9b55f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:09.089585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.090028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.090471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.092982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 884/1801] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:09.098220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:09.109328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047880ee-d2b8-48c5-945e-b23cd4cdc802 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:09.113869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:09.115228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:09.183971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:09.185034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.186240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.186397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.187738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:09.189347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:09.190296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 918/1802] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:09.200949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:09.202980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 885/1803] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:09.203254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:09.205764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:09.215273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3f18-9783-4265-aca0-e268e7dded41 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:09.219775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:09.220755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.221034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.221307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] PATH_INFO: `/v3/projects/28ec47d2068342eb9eec1864ba7780c3/users/fcc5e4a1c845451d817afaeb10ccb98f/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.236666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ec47d2068342eb9eec1864ba7780c3, user_id=fcc5e4a1c845451d817afaeb10ccb98f, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:09.239289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:09.259325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80de0b4-9c2b-4007-8b44-fbb2a340c225 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:09.264738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0cbe-6848-422f-ba44-0482c16a658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:09.265786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0cbe-6848-422f-ba44-0482c16a658d service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.265786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0cbe-6848-422f-ba44-0482c16a658d service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.265949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0cbe-6848-422f-ba44-0482c16a658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.276247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0cbe-6848-422f-ba44-0482c16a658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:09.277792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0cbe-6848-422f-ba44-0482c16a658d service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:09.288175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 919/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:09.430602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 886/1805] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:09 2022] PUT /identity/v3/projects/28ec47d2068342eb9eec1864ba7780c3/users/fcc5e4a1c845451d817afaeb10ccb98f/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:09.441773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.442063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.442340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.471881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] MFA Rules not processed for user `fcc5e4a1c845451d817afaeb10ccb98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:09.484649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:09.622928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 920/1806] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:09.623510 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:09.639929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff4f0-37ef-4657-8e3c-3cd204fe36c8 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:09.646236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:09.647675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:09.648392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:09.648392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:09.649100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:09.650774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:09.908442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 887/1807] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:09 2022] POST /identity/v3/projects => generated 381 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:09.913482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:09.927439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331388b-7440-40e4-aac2-c1a53caecbdc None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:09.999851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:10.002120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:10.067315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.068182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.068644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.069423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.070751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.073344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:10.215156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95acd85-773c-4924-9a7c-0728d7a44a6f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:10.221785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 921/1808] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:09 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:10.222767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:10.245155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.250411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b5cfe-0efc-4fe0-98e6-fad30f877316 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:10.250537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.250537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.250537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] PATH_INFO: `/v3/projects/e129857ba97d4b589f4881b66267c6d3` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.251394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.251725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e129857ba97d4b589f4881b66267c6d3)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.252149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.252444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.252724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.253459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.255797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:10.255926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:10.270740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 922/1809] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:10.276861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:10.294024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c148b-e0fc-4928-991e-884dfd6ce10f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:10.307265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.308740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.309352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.319423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] PATH_INFO: `/v3/projects/e443da44e2f44688afb4edec9b6807cf/users/01cf75cdb30a4bedae39cb0dd2525df8/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.329141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e443da44e2f44688afb4edec9b6807cf, user_id=01cf75cdb30a4bedae39cb0dd2525df8, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.331952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:10.467589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 923/1810] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:10 2022] PUT /identity/v3/projects/e443da44e2f44688afb4edec9b6807cf/users/01cf75cdb30a4bedae39cb0dd2525df8/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:10.468837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:10.504343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e129857ba97d4b589f4881b66267c6d3', 'request_id': 'req-7372240b-dba6-44bf-a4fa-92524b23e901'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:10.514647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e129857ba97d4b589f4881b66267c6d3', 'request_id': 'req-7372240b-dba6-44bf-a4fa-92524b23e901'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:10.577302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59b77-3e31-4f3d-a2b9-523f59e61370 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:10.618203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e129857ba97d4b589f4881b66267c6d3', 'request_id': 'req-7372240b-dba6-44bf-a4fa-92524b23e901'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:10.647546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] The token cache is being invalidate because project e129857ba97d4b589f4881b66267c6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:10.647852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:10.650236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:10.656698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 888/1811] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:09 2022] DELETE /identity/v3/projects/e129857ba97d4b589f4881b66267c6d3 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:10.660606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:10.662119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:10.692702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.696306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.696835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.697333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.698405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.700467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:10.717787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 924/1812] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:10.723746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:10.727254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:10.745797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc75f-c8b5-4ccf-8e43-c5f7f11a2e9e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:10.761624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efafc2-de16-4b90-b2ff-a266dafe5d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.763475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efafc2-de16-4b90-b2ff-a266dafe5d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.764018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efafc2-de16-4b90-b2ff-a266dafe5d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.764640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efafc2-de16-4b90-b2ff-a266dafe5d7a admin admin] PATH_INFO: `/v3/projects/e443da44e2f44688afb4edec9b6807cf/users/01cf75cdb30a4bedae39cb0dd2525df8/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.767233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efafc2-de16-4b90-b2ff-a266dafe5d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e443da44e2f44688afb4edec9b6807cf, user_id=01cf75cdb30a4bedae39cb0dd2525df8, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.773285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efafc2-de16-4b90-b2ff-a266dafe5d7a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:10.793337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 925/1813] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:10 2022] PUT /identity/v3/projects/e443da44e2f44688afb4edec9b6807cf/users/01cf75cdb30a4bedae39cb0dd2525df8/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:10.804968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:10.819820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.820452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.820452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.860870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372240b-dba6-44bf-a4fa-92524b23e901 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:10.888286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] MFA Rules not processed for user `01cf75cdb30a4bedae39cb0dd2525df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:10.896625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:10.954818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:10.957364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:10.957364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:10.957364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] PATH_INFO: `/v3/users/074fed2c09b34fd4b0dcd92ad7259fad` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:10.959379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=074fed2c09b34fd4b0dcd92ad7259fad)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:10.961809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:11.024900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 926/1814] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:11.047797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:11.053201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:11.171886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2d854-667e-467c-99ef-52ddf0920988 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:11.179081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:11.181836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:11.182241 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:11.182526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:11.202128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:11.204711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:11.238842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 927/1815] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:11.274284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074fed2c09b34fd4b0dcd92ad7259fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:11.366331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074fed2c09b34fd4b0dcd92ad7259fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:11.367487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074fed2c09b34fd4b0dcd92ad7259fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:11.368109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074fed2c09b34fd4b0dcd92ad7259fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:11.376475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074fed2c09b34fd4b0dcd92ad7259fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:11.424992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 889/1816] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:10 2022] DELETE /identity/v3/users/074fed2c09b34fd4b0dcd92ad7259fad => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:11.491091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:11.499840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd72b0-ab3d-4a98-b7d0-e5f2add2401e service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:11.553213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:11.585583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:11.585583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:11.585583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:11.585583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:11.588924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:11.655351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:11.656954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58c9e0-ec81-418d-9a9e-2c09826cb488 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:11.668550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 928/1817] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:12.017881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:12.019984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:12.099364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e125ae-eb3d-4e9c-812f-ec496dac6e5f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:12.105989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:12.107296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.107656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.107989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] PATH_INFO: `/v3/projects/71de1035b4bb46adba3e1df7c08e69a9` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.109792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71de1035b4bb46adba3e1df7c08e69a9)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:12.111870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:12.285208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71de1035b4bb46adba3e1df7c08e69a9', 'request_id': 'req-f743a12d-ab7b-442a-95d1-d96a1d104197'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:12.294107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71de1035b4bb46adba3e1df7c08e69a9', 'request_id': 'req-f743a12d-ab7b-442a-95d1-d96a1d104197'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:12.434426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71de1035b4bb46adba3e1df7c08e69a9', 'request_id': 'req-f743a12d-ab7b-442a-95d1-d96a1d104197'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:12.446003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] The token cache is being invalidate because project 71de1035b4bb46adba3e1df7c08e69a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:12.446376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:12.450014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f743a12d-ab7b-442a-95d1-d96a1d104197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:12.450014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 890/1818] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:12 2022] DELETE /identity/v3/projects/71de1035b4bb46adba3e1df7c08e69a9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:12.453429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.453921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.454016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.473009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:12.474222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:12.533506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 929/1819] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:12.541234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.541524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.541814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.562509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:12.563806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:12.572695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 891/1820] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:12.576953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:12.585516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:12.589397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67347fd2-f1b8-421e-9836-754715a5bbcd None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:12.594125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:12.594787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.595074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.595351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.596092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:12.596662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:12.598264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:12.612160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 930/1821] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:12.617256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:12.627160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0692f-4aa9-4ef9-85cf-2d5033020d02 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:12.632792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:12.634141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.634141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.634141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.634718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:12.636654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:12.773762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 892/1822] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:12 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:12.775187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:12.785274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028c269-96b4-4050-aa51-ea70019478ba admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:12.843058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:12.843742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.844031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.844353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.845093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:12.847518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:12.943751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 931/1823] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:12 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:12.945186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:12.961844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723e7cc-e22b-497b-8bcd-99c01cb3a5d3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:12.969237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:12.969985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:12.970275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:12.979214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:12.979214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:12.979214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:12.985218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 893/1824] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:12.989486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:12.999549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150563-fa12-4bc6-b196-34509e9c2635 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.004345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea924094-fb7c-4d5b-a55c-249cf281e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.005015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924094-fb7c-4d5b-a55c-249cf281e01a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.005302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924094-fb7c-4d5b-a55c-249cf281e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.005583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924094-fb7c-4d5b-a55c-249cf281e01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.006933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924094-fb7c-4d5b-a55c-249cf281e01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.008584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924094-fb7c-4d5b-a55c-249cf281e01a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.021164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 932/1825] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:13.026408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.037072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b104a-01d6-4d16-be97-09984f1f65b6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.042130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.043082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.043336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.043744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] PATH_INFO: `/v3/projects/d00ed3721b38435eb41276656efe7937/users/0d9c56f6becf48329ec08a16fe6d1351/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.059581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00ed3721b38435eb41276656efe7937, user_id=0d9c56f6becf48329ec08a16fe6d1351, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.062444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.141994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 894/1826] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:13 2022] PUT /identity/v3/projects/d00ed3721b38435eb41276656efe7937/users/0d9c56f6becf48329ec08a16fe6d1351/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:13.157707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.158001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.158281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.190886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] MFA Rules not processed for user `0d9c56f6becf48329ec08a16fe6d1351`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:13.192496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:13.271410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 933/1827] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:13.277542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.326401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:13.350375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86a9b-f64b-4e36-9afb-57eb834b02f5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.355318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.355989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.356308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.356662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.357280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.359482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.503871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 895/1828] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:13 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:13.504432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.515661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047395c1-8109-4c2c-bc19-42e9e8d6fdd5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.552737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:13.573116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.573827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.574122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.574401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.575112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.577083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.677278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 934/1829] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:13 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:13.681792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.692216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e8cec-d723-4566-b2e3-7f881c37a0a6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.697540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.698203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.698495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.698776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.699500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.701232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.712207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 896/1830] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:13.716333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.727692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318923a8-310b-43e5-a7a8-be2467522d3c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.732308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.733276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.733635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.733925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] PATH_INFO: `/v3/projects/e9164d3c74254772ba2f67a806052b6d/users/da6de6af1e014d50ba3084831b4a1f6a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.749466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9164d3c74254772ba2f67a806052b6d, user_id=da6de6af1e014d50ba3084831b4a1f6a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.752323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.867553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 935/1831] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:13 2022] PUT /identity/v3/projects/e9164d3c74254772ba2f67a806052b6d/users/da6de6af1e014d50ba3084831b4a1f6a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:13.876907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.886984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32751b74-2a4f-43f7-a378-85e5b6ff29f0 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.941797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e5a0-0158-45f1-929b-0042ac54c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.942471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e5a0-0158-45f1-929b-0042ac54c143 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.942752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e5a0-0158-45f1-929b-0042ac54c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.943028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e5a0-0158-45f1-929b-0042ac54c143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.943834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e5a0-0158-45f1-929b-0042ac54c143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.945496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e5a0-0158-45f1-929b-0042ac54c143 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.955293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 897/1832] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:13.959463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:13.969577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6efe-516e-41cd-81d3-42b8aaaca8fb admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:13.974386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:13.975868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:13.976210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:13.976483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] PATH_INFO: `/v3/projects/e9164d3c74254772ba2f67a806052b6d/users/da6de6af1e014d50ba3084831b4a1f6a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:13.978464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9164d3c74254772ba2f67a806052b6d, user_id=da6de6af1e014d50ba3084831b4a1f6a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:13.981148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:13.991879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 936/1833] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:13 2022] PUT /identity/v3/projects/e9164d3c74254772ba2f67a806052b6d/users/da6de6af1e014d50ba3084831b4a1f6a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:14.002014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b7dd4-f56d-4e50-af41-5c256ffd3ff2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:14.002308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b7dd4-f56d-4e50-af41-5c256ffd3ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:14.002620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b7dd4-f56d-4e50-af41-5c256ffd3ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:14.029162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-fe9b7dd4-f56d-4e50-af41-5c256ffd3ff2 None None] MFA Rules not processed for user `da6de6af1e014d50ba3084831b4a1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:14.030371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fe9b7dd4-f56d-4e50-af41-5c256ffd3ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:14.125880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:14.127877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:14.132751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 898/1834] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:14.247370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed4b9-40e9-4144-9687-3163037da0a2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:14.252047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172c700-a439-41db-8db5-d169ead120e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:14.254519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172c700-a439-41db-8db5-d169ead120e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:14.254855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172c700-a439-41db-8db5-d169ead120e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:14.255328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172c700-a439-41db-8db5-d169ead120e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:14.269254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172c700-a439-41db-8db5-d169ead120e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:14.271014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172c700-a439-41db-8db5-d169ead120e9 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:14.289414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 937/1835] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:15.727117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:15.914714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:16.383392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ebfd-809e-467c-bcb4-5d190b28b92a None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:16.384283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ebfd-809e-467c-bcb4-5d190b28b92a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:16.384770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ebfd-809e-467c-bcb4-5d190b28b92a None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:16.386481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 899/1836] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:47:16.404030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70c958-78ee-4393-b907-5d689876e09c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:16.404394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70c958-78ee-4393-b907-5d689876e09c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:16.404636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70c958-78ee-4393-b907-5d689876e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:16.450598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-df70c958-78ee-4393-b907-5d689876e09c None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:16.452034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-df70c958-78ee-4393-b907-5d689876e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:16.631227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 938/1837] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:16.655828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c6f7d-2d94-4868-8e24-eb511c9459d7 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:16.656148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c6f7d-2d94-4868-8e24-eb511c9459d7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:16.658546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c6f7d-2d94-4868-8e24-eb511c9459d7 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:16.662518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 900/1838] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:47:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:47:16.726765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:16.727724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:16.728398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:16.766820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:16.769735 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:16.783924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 939/1839] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:16.815650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c6f7d-2d94-4868-8e24-eb511c9459d7 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:16.817687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-106c6f7d-2d94-4868-8e24-eb511c9459d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:16.849464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c6f7d-2d94-4868-8e24-eb511c9459d7 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:16.859970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:16.861175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:16.861634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:16.862101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:16.889657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:16.893144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:16.901008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:16.902960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:16.923680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 901/1840] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:16.926334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437e68e-f270-45b2-ab9d-ffaf9883b461 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:16.932884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db689751-f839-4063-abb7-8d8cef2734e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:16.933852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689751-f839-4063-abb7-8d8cef2734e2 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:16.934131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689751-f839-4063-abb7-8d8cef2734e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:16.939898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689751-f839-4063-abb7-8d8cef2734e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:16.949488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db689751-f839-4063-abb7-8d8cef2734e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:16.951739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db689751-f839-4063-abb7-8d8cef2734e2 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:16.975664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 940/1841] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:17.821011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:18.909193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:19.528608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:19.592859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd2bf7-2d30-4c2d-a39d-3cc9e3670590 service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:19.597760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:19.598632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:19.598915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:19.599188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] PATH_INFO: `/v3/users/0d9c56f6becf48329ec08a16fe6d1351` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:19.601122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9c56f6becf48329ec08a16fe6d1351)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:19.606217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:19.889166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9c56f6becf48329ec08a16fe6d1351'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:19.999608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9c56f6becf48329ec08a16fe6d1351'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.000273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9c56f6becf48329ec08a16fe6d1351'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.000898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9c56f6becf48329ec08a16fe6d1351'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.009530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9c56f6becf48329ec08a16fe6d1351'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.027664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 902/1842] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:19 2022] DELETE /identity/v3/users/0d9c56f6becf48329ec08a16fe6d1351 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:20.032219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:20.032681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:20.032867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:20.049979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:20.051212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:20.112975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 941/1843] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:20.122945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:20.124465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:20.182035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fedf3-9d5f-4a67-821e-adc476689da5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:20.185638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:20.186293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:20.186574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:20.186848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:20.196230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:20.197645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:20.207039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 903/1844] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:20.642436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:20.643667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:20.656691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5adc-23b5-4211-8f70-2c01d97f7441 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:20.660947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:20.671255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:20.671255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:20.671255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] PATH_INFO: `/v3/projects/d00ed3721b38435eb41276656efe7937` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:20.671255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00ed3721b38435eb41276656efe7937)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:20.671255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:20.756199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00ed3721b38435eb41276656efe7937', 'request_id': 'req-0b1caaf6-7559-4dbe-9a47-1de880803885'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.902633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00ed3721b38435eb41276656efe7937', 'request_id': 'req-0b1caaf6-7559-4dbe-9a47-1de880803885'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.909591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00ed3721b38435eb41276656efe7937', 'request_id': 'req-0b1caaf6-7559-4dbe-9a47-1de880803885'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.920866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] The token cache is being invalidate because project d00ed3721b38435eb41276656efe7937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:20.921157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.921818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:20.923417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 942/1845] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:20 2022] DELETE /identity/v3/projects/d00ed3721b38435eb41276656efe7937 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:20.927496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:20.937795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c939-1c34-420b-8d93-70deeb894c80 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:20.998152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:20.999042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:20.999332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:20.999606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] PATH_INFO: `/v3/users/da6de6af1e014d50ba3084831b4a1f6a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:21.000857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6de6af1e014d50ba3084831b4a1f6a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:21.002896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:21.080210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:21.214265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6de6af1e014d50ba3084831b4a1f6a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:21.297075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6de6af1e014d50ba3084831b4a1f6a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:21.297775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6de6af1e014d50ba3084831b4a1f6a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:21.298534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6de6af1e014d50ba3084831b4a1f6a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:21.311120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f0822a68-d06b-4f8c-bad0-d4a37ba237a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6de6af1e014d50ba3084831b4a1f6a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:21.334786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 904/1846] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:20 2022] DELETE /identity/v3/users/da6de6af1e014d50ba3084831b4a1f6a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:21.466578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:21.886440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:21.888121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:21.901748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1caaf6-7559-4dbe-9a47-1de880803885 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:21.961378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:21.962251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:21.962534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:21.962807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] PATH_INFO: `/v3/projects/e9164d3c74254772ba2f67a806052b6d` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:21.964028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9164d3c74254772ba2f67a806052b6d)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:21.965983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.100797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9164d3c74254772ba2f67a806052b6d', 'request_id': 'req-faa19c15-2f7f-4940-a7e5-a92016c9ee81'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:22.196976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9164d3c74254772ba2f67a806052b6d', 'request_id': 'req-faa19c15-2f7f-4940-a7e5-a92016c9ee81'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:22.203203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9164d3c74254772ba2f67a806052b6d', 'request_id': 'req-faa19c15-2f7f-4940-a7e5-a92016c9ee81'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:22.215211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] The token cache is being invalidate because project e9164d3c74254772ba2f67a806052b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:22.215501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:22.216191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-faa19c15-2f7f-4940-a7e5-a92016c9ee81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:22.217762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 943/1847] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:21 2022] DELETE /identity/v3/projects/e9164d3c74254772ba2f67a806052b6d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:22.222908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.223380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.223482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.242361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:22.243685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:22.306041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 905/1848] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:22.313707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.314145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.314487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.339629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:22.341001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:22.350706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 944/1849] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:22.360788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:22.372274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ebeda-1d0b-493c-b236-6ae259493d50 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:22.378916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:22.379784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.380295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.383711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.383711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:22.383711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:22.384487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.397927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 906/1850] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:22.402531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:22.414060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc974e-0b48-45c3-9147-9e634f59fc3f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:22.420241 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:22.421966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.422264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.422551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.423361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:22.425359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.554079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 945/1851] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:22 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:22.563363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:22.574419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b18c0-b89b-495f-af26-8d0d6927162d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:22.580658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:22.632799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:22.633475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.633756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.634028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.634709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:22.636636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.726250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 907/1852] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:22 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:22.730655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:22.742386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d9545-7adf-4e87-be75-b2603ea81386 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:22.747101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:22.747765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.748064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.748358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.749075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:22.750749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.761827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 946/1853] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:22.765711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:22.775709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943598ae-3fec-4a21-8d91-2b2113f1b482 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:22.780330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c973a4-ad59-49b4-b470-7f78302d9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:22.780987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c973a4-ad59-49b4-b470-7f78302d9149 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.781272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c973a4-ad59-49b4-b470-7f78302d9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.786242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c973a4-ad59-49b4-b470-7f78302d9149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.786242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c973a4-ad59-49b4-b470-7f78302d9149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:22.786242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c973a4-ad59-49b4-b470-7f78302d9149 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.794293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 908/1854] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:22.798344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:22.808767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a364eb-36ee-41cc-8124-abb8a4031d5f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:22.814827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:22.814827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.814827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.814827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] PATH_INFO: `/v3/projects/d86441d3300145f5a828eebc2ba7634a/users/2b9881ebc9644421a17b52dabfa9e581/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.829249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86441d3300145f5a828eebc2ba7634a, user_id=2b9881ebc9644421a17b52dabfa9e581, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:22.831936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:22.888974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 947/1855] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:22 2022] PUT /identity/v3/projects/d86441d3300145f5a828eebc2ba7634a/users/2b9881ebc9644421a17b52dabfa9e581/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:22.901369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:22.901369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:22.901792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:22.934530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] MFA Rules not processed for user `2b9881ebc9644421a17b52dabfa9e581`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:22.936043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:23.002750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 909/1856] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:23.007456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.038190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:23.071266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a716598-1209-4fd0-9775-4e85dc9c502b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.076039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.076730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.077019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.077290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.077979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.079873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.227832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 948/1857] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:23 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:23.231949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.243217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8d6c-2712-46a7-bfc8-6ecb9b231781 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.298068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.298732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.299012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.299284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.300001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.301960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.336962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:23.451814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 910/1858] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:23 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:23.455598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.465996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dbdd6-ee36-4a8a-a24e-15c284af975c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.470936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.471873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.472207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.472472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.473191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.476878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.488195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 949/1859] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:23.493090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.503288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ee00-87da-4338-a921-afd25f0e1d60 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.508163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.509045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.509327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.509611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] PATH_INFO: `/v3/projects/34d1565d0aeb41a981ad84e3f6fc0cb1/users/7e9d963b48c749c8b3b4ffba0179b57e/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.524349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d1565d0aeb41a981ad84e3f6fc0cb1, user_id=7e9d963b48c749c8b3b4ffba0179b57e, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.526972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.626606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 911/1860] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:23 2022] PUT /identity/v3/projects/34d1565d0aeb41a981ad84e3f6fc0cb1/users/7e9d963b48c749c8b3b4ffba0179b57e/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:23.630871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.641809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de6507-bcae-4a4a-bb57-726b8725ec05 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.710445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ca252-bd64-48a4-b498-0c21f9848d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.711234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ca252-bd64-48a4-b498-0c21f9848d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.711611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ca252-bd64-48a4-b498-0c21f9848d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.712134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ca252-bd64-48a4-b498-0c21f9848d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.712864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ca252-bd64-48a4-b498-0c21f9848d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.714507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ca252-bd64-48a4-b498-0c21f9848d63 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.725740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 950/1861] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:23.730119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.741253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0d10-3dac-4f21-b070-bc6c0d9ef6a4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.746006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.746940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.747223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.747500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] PATH_INFO: `/v3/projects/34d1565d0aeb41a981ad84e3f6fc0cb1/users/7e9d963b48c749c8b3b4ffba0179b57e/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.749592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d1565d0aeb41a981ad84e3f6fc0cb1, user_id=7e9d963b48c749c8b3b4ffba0179b57e, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.752289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.764444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 912/1862] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:23 2022] PUT /identity/v3/projects/34d1565d0aeb41a981ad84e3f6fc0cb1/users/7e9d963b48c749c8b3b4ffba0179b57e/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:23.774588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.774921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.775197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.803288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] MFA Rules not processed for user `7e9d963b48c749c8b3b4ffba0179b57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:23.804531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:23.870526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 951/1863] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:23.887365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:23.889202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:23.947984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51958b68-bdb7-46cb-b082-207f347cbcb9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:23.951896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:23.952586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:23.952871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:23.959165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:23.962625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:23.964125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:23.973827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 913/1864] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:24.477609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:24.605582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:25.088375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:25.103341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16501d5-46e6-439f-95ac-555e5882ac5e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:25.108666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9d963b48c749c8b3b4ffba0179b57e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:25.109407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:25.109694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:25.110184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:25.111307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:25.111863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:25.114291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:25.127063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 952/1865] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:25.132100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:25.141311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4332ec-8ac8-4bf5-9c5f-9c7bececa5b5 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:25.145926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9d963b48c749c8b3b4ffba0179b57e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:25.147208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:25.147502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:25.147771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:25.148499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:25.150441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:25.330584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 914/1866] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:25 2022] POST /identity/v3/projects => generated 355 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:25.331774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:25.343370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d944a09-5f87-49c9-a81b-bba4ed6419c2 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:25.405648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:25.495518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9d963b48c749c8b3b4ffba0179b57e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:25.496600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:25.497011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:25.497389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:25.499052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:25.499052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:25.504148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:25.531706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 953/1867] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:25.574531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:25.586542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e76db-5730-4915-a43f-9297d7ca38cf tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:25.589433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9d963b48c749c8b3b4ffba0179b57e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:25.590298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:25.590585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:25.590863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] PATH_INFO: `/v3/projects/69757adb60794123bffeed4ee536d878` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:25.592035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69757adb60794123bffeed4ee536d878)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:25.593964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:25.786463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69757adb60794123bffeed4ee536d878', 'request_id': 'req-7fff88ac-6e6d-4b89-9be1-252865ceefc6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:25.793751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69757adb60794123bffeed4ee536d878', 'request_id': 'req-7fff88ac-6e6d-4b89-9be1-252865ceefc6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:25.945661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69757adb60794123bffeed4ee536d878', 'request_id': 'req-7fff88ac-6e6d-4b89-9be1-252865ceefc6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:25.958149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] The token cache is being invalidate because project 69757adb60794123bffeed4ee536d878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:25.958743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:25.959615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:25.961286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 915/1868] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:25 2022] DELETE /identity/v3/projects/69757adb60794123bffeed4ee536d878 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:26.310529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:26.523552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:26.526490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:26.609866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca75b1-1a1b-41af-964a-01de78f77e20 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:26.667858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:26.668696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:26.668980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:26.669254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] PATH_INFO: `/v3/users/fcc5e4a1c845451d817afaeb10ccb98f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:26.670640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc5e4a1c845451d817afaeb10ccb98f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:26.672649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:26.932223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc5e4a1c845451d817afaeb10ccb98f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:26.932877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc5e4a1c845451d817afaeb10ccb98f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.003470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:27.031709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc5e4a1c845451d817afaeb10ccb98f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.032560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc5e4a1c845451d817afaeb10ccb98f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.049115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-21d26d67-279e-4fa1-8c6d-858e3c8272ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc5e4a1c845451d817afaeb10ccb98f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.078146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:27.080335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:27.109239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff88ac-6e6d-4b89-9be1-252865ceefc6 tempest-VolumeQuotaClassesTest-1197630397 tempest-VolumeQuotaClassesTest-1197630397-project-admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:27.113361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 954/1869] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:26 2022] DELETE /identity/v3/users/fcc5e4a1c845451d817afaeb10ccb98f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:27.133558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:27.133884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:27.134106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:27.187409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:27.190960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:27.284339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:27.285257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:27.285538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:27.288419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] PATH_INFO: `/v3/users/2b9881ebc9644421a17b52dabfa9e581` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:27.292947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9881ebc9644421a17b52dabfa9e581)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:27.296555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:27.376577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 955/1870] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:27.390514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:27.392111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:27.497805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9881ebc9644421a17b52dabfa9e581'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.515549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30153-dab8-41f4-b294-610acec698c1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:27.523090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924823e6-b83e-40c5-8f20-17954f8608db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:27.524343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924823e6-b83e-40c5-8f20-17954f8608db service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:27.524892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924823e6-b83e-40c5-8f20-17954f8608db service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:27.525156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924823e6-b83e-40c5-8f20-17954f8608db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:27.551881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924823e6-b83e-40c5-8f20-17954f8608db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:27.553455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924823e6-b83e-40c5-8f20-17954f8608db service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:27.567213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 956/1871] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:27.588381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9881ebc9644421a17b52dabfa9e581'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.589117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9881ebc9644421a17b52dabfa9e581'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.589742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9881ebc9644421a17b52dabfa9e581'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.602717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9881ebc9644421a17b52dabfa9e581'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:27.631160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 916/1872] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:27 2022] DELETE /identity/v3/users/2b9881ebc9644421a17b52dabfa9e581 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:27.635771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:27.636220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:27.636803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:27.655565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:27.656994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:27.739258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 957/1873] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:27.758901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:27.760374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:27.827668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca87990-c7e7-43e8-8c33-9e404bf7e04f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:27.831220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:27.831979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:27.832290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:27.832562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:27.842123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:27.843529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:27.853852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 917/1874] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:28.050082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:28.281312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:28.282745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:28.294593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82616395-b9f3-47dc-b2d0-551cb3386922 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:28.299368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:28.300713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:28.301013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:28.301283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] PATH_INFO: `/v3/projects/28ec47d2068342eb9eec1864ba7780c3` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:28.302643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ec47d2068342eb9eec1864ba7780c3)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:28.312820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:28.367436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:28.370193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:28.384321 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826e4d-6107-41b4-b3d2-4bfc2643cf6b service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:28.397310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:28.398297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:28.399022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:28.399382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] PATH_INFO: `/v3/projects/d86441d3300145f5a828eebc2ba7634a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:28.400728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86441d3300145f5a828eebc2ba7634a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:28.402739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:28.409233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ec47d2068342eb9eec1864ba7780c3', 'request_id': 'req-11b0f1b7-9175-4193-949d-582067a0437f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.490589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ec47d2068342eb9eec1864ba7780c3', 'request_id': 'req-11b0f1b7-9175-4193-949d-582067a0437f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.496716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ec47d2068342eb9eec1864ba7780c3', 'request_id': 'req-11b0f1b7-9175-4193-949d-582067a0437f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.508743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] The token cache is being invalidate because project 28ec47d2068342eb9eec1864ba7780c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:28.508895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86441d3300145f5a828eebc2ba7634a', 'request_id': 'req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.509050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.509702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.511309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 958/1875] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:28 2022] DELETE /identity/v3/projects/28ec47d2068342eb9eec1864ba7780c3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:28.515096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:28.516427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:28.518143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86441d3300145f5a828eebc2ba7634a', 'request_id': 'req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.580438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f1b7-9175-4193-949d-582067a0437f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:28.635580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:28.636631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:28.636899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:28.637175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] PATH_INFO: `/v3/users/01cf75cdb30a4bedae39cb0dd2525df8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:28.638365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cf75cdb30a4bedae39cb0dd2525df8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:28.640321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:28.656599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86441d3300145f5a828eebc2ba7634a', 'request_id': 'req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.668921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] The token cache is being invalidate because project d86441d3300145f5a828eebc2ba7634a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:28.669207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.669924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.671724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 918/1876] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:28 2022] DELETE /identity/v3/projects/d86441d3300145f5a828eebc2ba7634a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:28.675466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:28.676823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:28.690791 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd84dd-8d68-4ad7-bb75-908811aabe7c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:28.696230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:28.697014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:28.697325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:28.697595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] PATH_INFO: `/v3/users/7e9d963b48c749c8b3b4ffba0179b57e` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:28.698768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9d963b48c749c8b3b4ffba0179b57e)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:28.700698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:28.748287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:28.828171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cf75cdb30a4bedae39cb0dd2525df8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.828843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cf75cdb30a4bedae39cb0dd2525df8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.860271 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9d963b48c749c8b3b4ffba0179b57e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.908477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cf75cdb30a4bedae39cb0dd2525df8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.909111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cf75cdb30a4bedae39cb0dd2525df8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.917224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cf75cdb30a4bedae39cb0dd2525df8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.941166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 959/1877] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:28 2022] DELETE /identity/v3/users/01cf75cdb30a4bedae39cb0dd2525df8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:28.988279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9d963b48c749c8b3b4ffba0179b57e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.988969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9d963b48c749c8b3b4ffba0179b57e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:28.989828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9d963b48c749c8b3b4ffba0179b57e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.006554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9d963b48c749c8b3b4ffba0179b57e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.034757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 919/1878] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:28 2022] DELETE /identity/v3/users/7e9d963b48c749c8b3b4ffba0179b57e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:29.180395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:29.553214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:29.554657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:29.567032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:29.573138 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:29.628976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:29.633298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46e315-52d7-495d-8ede-946ccd8507da admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:29.652216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd0027-cb23-4d60-9da2-7eb1bc721312 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:29.656774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:29.657635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:29.657913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:29.658188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] PATH_INFO: `/v3/projects/e443da44e2f44688afb4edec9b6807cf` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:29.659368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e443da44e2f44688afb4edec9b6807cf)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:29.662723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:29.691280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:29.692251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:29.692538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:29.693355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] PATH_INFO: `/v3/projects/34d1565d0aeb41a981ad84e3f6fc0cb1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:29.694749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d1565d0aeb41a981ad84e3f6fc0cb1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:29.696756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:29.768498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e443da44e2f44688afb4edec9b6807cf', 'request_id': 'req-0888ffca-eef4-4ddb-8729-98f1458901e9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.775270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e443da44e2f44688afb4edec9b6807cf', 'request_id': 'req-0888ffca-eef4-4ddb-8729-98f1458901e9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.791087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'request_id': 'req-b955f935-8acd-46e1-836d-92c80e788ee3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.859611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e443da44e2f44688afb4edec9b6807cf', 'request_id': 'req-0888ffca-eef4-4ddb-8729-98f1458901e9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.871263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] The token cache is being invalidate because project e443da44e2f44688afb4edec9b6807cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:29.871549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.872194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0888ffca-eef4-4ddb-8729-98f1458901e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.873727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 920/1879] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:29 2022] DELETE /identity/v3/projects/e443da44e2f44688afb4edec9b6807cf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:29.878448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddee12-2fda-412f-aa22-766aac2309af None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:29.878741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddee12-2fda-412f-aa22-766aac2309af None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:29.879025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddee12-2fda-412f-aa22-766aac2309af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:29.888613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:29.898013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1fddee12-2fda-412f-aa22-766aac2309af None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:29.899307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1fddee12-2fda-412f-aa22-766aac2309af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:29.953287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'request_id': 'req-b955f935-8acd-46e1-836d-92c80e788ee3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.957805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 921/1880] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:29.960864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d1565d0aeb41a981ad84e3f6fc0cb1', 'request_id': 'req-b955f935-8acd-46e1-836d-92c80e788ee3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.965696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:29.965982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:29.966257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:29.972422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] The token cache is being invalidate because project 34d1565d0aeb41a981ad84e3f6fc0cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:29.972712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.973359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b955f935-8acd-46e1-836d-92c80e788ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:29.975079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 960/1881] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:29 2022] DELETE /identity/v3/projects/34d1565d0aeb41a981ad84e3f6fc0cb1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:29.982844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700b2e-c6a4-4496-a0a5-637453a27988 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:29.983137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700b2e-c6a4-4496-a0a5-637453a27988 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:29.983419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700b2e-c6a4-4496-a0a5-637453a27988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:29.984202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:29.985390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:29.994416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 922/1882] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:29.998614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.002125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-53700b2e-c6a4-4496-a0a5-637453a27988 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:30.003348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-53700b2e-c6a4-4496-a0a5-637453a27988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:30.009243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1ee9f-1fcf-49b0-933a-38d391c16d94 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.014001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.014667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.014948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.015400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.020362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 961/1883] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:30.020441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:30.020441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.020441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.028081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.028609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.029023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.034909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 923/1884] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:47:30.035515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.047502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02e7c-0ba7-4248-bee6-9c253c1a6e99 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.054246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.054246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.054246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.054246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.054958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.056792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:30.057037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.058633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:30.072085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 962/1885] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:30.073858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.084721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d8b07-c457-450d-9ce0-c98a45b0a265 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.096234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.097422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.097833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.098165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.099060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:30.099453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.102322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.116159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 963/1886] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:30.120833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.130128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3bf0-5015-4e8f-b0b3-f3d5351bff0a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.135050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.135778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.136166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.136447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.137139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.139024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.157144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 924/1887] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:30.161341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.225651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9922b8-5402-4735-b87b-1be8e1753639 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.230340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.231021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.231360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.231576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.232347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.234288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.243258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 964/1888] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:30.247775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.312347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62735139-19d8-4b13-86fc-216123d1fa2e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.318849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.319947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.320402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.320868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.321916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.324462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.366479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 925/1889] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:30.370590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.386287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ded8-c615-44a1-a44b-83c5d95175c6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.393629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.403566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.403566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.403566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.403566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.403566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.425578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 926/1890] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:30.426661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.437820 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149ea9-4588-4b06-aa38-95b7d76a6d0c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.444700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.451223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.451223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.451223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.451223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.451223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.469340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 927/1891] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:30.470839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.492894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 965/1892] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/users => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:30.495289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846d04-2566-4cdb-9d52-a60b36526334 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.500922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.506577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9d4a-a781-4ed2-b855-957a063c55e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.508304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9d4a-a781-4ed2-b855-957a063c55e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.509792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9d4a-a781-4ed2-b855-957a063c55e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.510747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9d4a-a781-4ed2-b855-957a063c55e3 admin admin] PATH_INFO: `/v3/projects/7c0ce34020bb47b391fcdb5928060f45/users/39ab5c0bf1b344dbb251861aec3eb999/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.525095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255b225-a05b-44d8-9e93-7dca394052be admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.533555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9d4a-a781-4ed2-b855-957a063c55e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0ce34020bb47b391fcdb5928060f45, user_id=39ab5c0bf1b344dbb251861aec3eb999, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.537273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9d4a-a781-4ed2-b855-957a063c55e3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.539795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.540362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.540674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.540917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.541813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.543444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.559805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 966/1893] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:30.563685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.575284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06536-0c82-41f7-ac12-e69cf7e734e1 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.581542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.582239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.582527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.582803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.583861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.587205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.601970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 967/1894] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:30.612901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.623529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec91de-7f0c-44a3-b319-cc09cbd65f6d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.628946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24731e8-2f30-419b-9988-f91db94ab1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.630065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24731e8-2f30-419b-9988-f91db94ab1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.630384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24731e8-2f30-419b-9988-f91db94ab1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.630661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24731e8-2f30-419b-9988-f91db94ab1f9 admin admin] PATH_INFO: `/v3/projects/bc2b634a1b814f8e84ce57706d821f06/users/7371da81b15f4c99b9fe08ae026606fb/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.648426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24731e8-2f30-419b-9988-f91db94ab1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2b634a1b814f8e84ce57706d821f06, user_id=7371da81b15f4c99b9fe08ae026606fb, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.652695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24731e8-2f30-419b-9988-f91db94ab1f9 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.721629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 928/1895] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:30 2022] PUT /identity/v3/projects/7c0ce34020bb47b391fcdb5928060f45/users/39ab5c0bf1b344dbb251861aec3eb999/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:30.733464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.733762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.734612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.769107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] MFA Rules not processed for user `39ab5c0bf1b344dbb251861aec3eb999`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:30.770387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:30.793809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 968/1896] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:30 2022] PUT /identity/v3/projects/bc2b634a1b814f8e84ce57706d821f06/users/7371da81b15f4c99b9fe08ae026606fb/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:30.798294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.799051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.799414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.854949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 929/1897] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:30.857984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] MFA Rules not processed for user `7371da81b15f4c99b9fe08ae026606fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:30.859406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:30.859520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.924583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61952fef-e69c-4fb1-a6cd-a3dd3953d9d8 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:30.930368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 969/1898] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:30.931360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:30.986394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:30.987262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:30.987706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:30.988148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:30.988856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:30.991355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:30.999623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3388c5-8ebd-4e9f-b3c8-6ff08c6af151 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.005967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.006723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.007077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.007272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.007976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.009925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.122603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 930/1899] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:31.127827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.140900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 970/1900] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:30 2022] POST /identity/v3/projects => generated 401 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:31.144817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.220294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900495-485a-4f32-bd36-ecc002a9cb05 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.225889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd655-aca0-4d5f-b262-52f771548155 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.228402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.229299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.229767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.230223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.230328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.231160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.231413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.231732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.232019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.232996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.234205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.235023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.246290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:31.320347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 971/1901] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:31 2022] POST /identity/v3/users => generated 307 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:31.324197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.335741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5277d-c8e5-4aa4-9395-f0ec7b5451f2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.342702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.343432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.343726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.344027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.345307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.348158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.359348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 931/1902] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:31 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:31.360511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.369207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 972/1903] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:31.370301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.377950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7368c-4a4a-4bfc-aaa0-acb82b8a316e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.384448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.385718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58187d75-9de9-4181-83b9-b90ca294847f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.385933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.386456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.386981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.387920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.389944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.390485 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.391507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.392092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.392468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] PATH_INFO: `/v3/projects/e75cbdf70cfd4fd88070a99a9bed7173/users/a9e9afa765324f5bbb31920aa54cab9b/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.404479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 932/1904] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:31.407371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.416494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75cbdf70cfd4fd88070a99a9bed7173, user_id=a9e9afa765324f5bbb31920aa54cab9b, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.420505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.423620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e3d07-363f-4dfc-93ac-c6719623ead6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.431025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.432396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.432396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.436825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] PATH_INFO: `/v3/projects/a9dcf8a42e6d414f883b48073be14bc8/users/eba31c2808cd466888ef2825a81e446a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.457618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9dcf8a42e6d414f883b48073be14bc8, user_id=eba31c2808cd466888ef2825a81e446a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.461146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.534442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 973/1905] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:31 2022] PUT /identity/v3/projects/e75cbdf70cfd4fd88070a99a9bed7173/users/a9e9afa765324f5bbb31920aa54cab9b/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:31.539076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.583045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:31.605233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071ebc0-0b02-4c81-aa1b-ce4586467c48 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.614191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.615025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.615373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.615731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.616496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.618232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.630003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 974/1906] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:31.633968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.641548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 933/1907] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:31 2022] PUT /identity/v3/projects/a9dcf8a42e6d414f883b48073be14bc8/users/eba31c2808cd466888ef2825a81e446a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:31.646575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.647775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d25c67-2563-4332-b66d-733883626926 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.716558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28f0c-8616-49d3-ac3d-1ca00ebcd9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.717570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28f0c-8616-49d3-ac3d-1ca00ebcd9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.722669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28f0c-8616-49d3-ac3d-1ca00ebcd9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.722669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28f0c-8616-49d3-ac3d-1ca00ebcd9a6 admin admin] PATH_INFO: `/v3/projects/e75cbdf70cfd4fd88070a99a9bed7173/users/a9e9afa765324f5bbb31920aa54cab9b/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.722669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c28f0c-8616-49d3-ac3d-1ca00ebcd9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75cbdf70cfd4fd88070a99a9bed7173, user_id=a9e9afa765324f5bbb31920aa54cab9b, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.725874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c28f0c-8616-49d3-ac3d-1ca00ebcd9a6 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.736956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296ca7-5461-4642-acc3-6f3398697b44 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.738544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 975/1908] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:31 2022] PUT /identity/v3/projects/e75cbdf70cfd4fd88070a99a9bed7173/users/a9e9afa765324f5bbb31920aa54cab9b/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:31.750165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.751286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.751678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.780143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] MFA Rules not processed for user `a9e9afa765324f5bbb31920aa54cab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:31.781352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:31.809954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.810628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.810914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.811198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.811928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.813545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.823461 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 934/1909] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:31.827703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.837243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d62b-7c2b-4689-aac8-490035e00b58 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:31.844470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a4e4-9d4d-46d4-892e-3031ad03c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:31.845482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a4e4-9d4d-46d4-892e-3031ad03c8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.848667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a4e4-9d4d-46d4-892e-3031ad03c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.848667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a4e4-9d4d-46d4-892e-3031ad03c8a0 admin admin] PATH_INFO: `/v3/projects/a9dcf8a42e6d414f883b48073be14bc8/users/eba31c2808cd466888ef2825a81e446a/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.848667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037a4e4-9d4d-46d4-892e-3031ad03c8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9dcf8a42e6d414f883b48073be14bc8, user_id=eba31c2808cd466888ef2825a81e446a, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:31.851988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037a4e4-9d4d-46d4-892e-3031ad03c8a0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:31.853820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 976/1910] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:31.874719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 935/1911] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:31 2022] PUT /identity/v3/projects/a9dcf8a42e6d414f883b48073be14bc8/users/eba31c2808cd466888ef2825a81e446a/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:31.877445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:31.880971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:31.894190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:31.894483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:31.894872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:31.931866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] MFA Rules not processed for user `eba31c2808cd466888ef2825a81e446a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:31.936179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:31.981525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbcae2-080d-4720-ad05-16a691aaa1d5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:32.038869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 936/1912] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:32.068718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:32.069074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:32.069353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:32.069623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:32.130878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:32.132282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:32.145327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 977/1913] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:32.150124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:32.151736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:32.164490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f328d-3e97-450c-b750-1e5e1d1974ad None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:32.168167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:32.168815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:32.169175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:32.169494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:32.179799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:32.181329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:32.190708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 937/1914] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:32.220190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:32.297081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d086cc-6aff-43f7-91ee-06174f9be4b2 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:32.302744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:32.304173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:32.304457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:32.304732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] PATH_INFO: `/v3/users/39ab5c0bf1b344dbb251861aec3eb999` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:32.305961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ab5c0bf1b344dbb251861aec3eb999)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:32.307883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:32.534242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:32.535602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ab5c0bf1b344dbb251861aec3eb999'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:32.536290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ab5c0bf1b344dbb251861aec3eb999'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:32.544584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf975-f0c6-4ed4-a233-4a4197e85d8e service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:32.548540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:32.549198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:32.549479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:32.549753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:32.607080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ab5c0bf1b344dbb251861aec3eb999'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:32.608444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ab5c0bf1b344dbb251861aec3eb999'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:32.619470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b2bef66e-33dc-48a9-8e4c-91e58568ea41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ab5c0bf1b344dbb251861aec3eb999'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:32.626288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:32.628824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:32.647158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 978/1915] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:32 2022] DELETE /identity/v3/users/39ab5c0bf1b344dbb251861aec3eb999 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:32.647261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 938/1916] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:32.647336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:32.647336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:32.647336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:32.669204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:32.670108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:32.831381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 979/1917] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:32.842603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:32.844268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:32.968169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:32.982397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2aa1-e11d-4119-8f56-4c16e7d24ac5 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:33.056302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:33.057014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:33.059612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:33.059612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:33.070393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:33.071899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:33.084148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 939/1918] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:33.240779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:33.693363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:33.695144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:33.716153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e4008-e4d4-49ff-8048-d9679ba9a7a5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:33.727004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:33.731247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:33.732221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:33.733194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] PATH_INFO: `/v3/projects/7c0ce34020bb47b391fcdb5928060f45` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:33.734828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0ce34020bb47b391fcdb5928060f45)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:33.745584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:33.906857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0ce34020bb47b391fcdb5928060f45', 'request_id': 'req-2aa90513-81e0-452b-bb77-af889092b19f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:33.983154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0ce34020bb47b391fcdb5928060f45', 'request_id': 'req-2aa90513-81e0-452b-bb77-af889092b19f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:33.990411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0ce34020bb47b391fcdb5928060f45', 'request_id': 'req-2aa90513-81e0-452b-bb77-af889092b19f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.003003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] The token cache is being invalidate because project 7c0ce34020bb47b391fcdb5928060f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:34.003282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.004371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.009260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 980/1919] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:33 2022] DELETE /identity/v3/projects/7c0ce34020bb47b391fcdb5928060f45 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:34.015113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:34.022330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aacc8-c688-4211-8eeb-5a738658f2a2 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:34.087232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:34.087995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:34.088308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:34.088590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] PATH_INFO: `/v3/users/eba31c2808cd466888ef2825a81e446a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:34.089969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba31c2808cd466888ef2825a81e446a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:34.091775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:34.399894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba31c2808cd466888ef2825a81e446a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.484350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:34.486194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba31c2808cd466888ef2825a81e446a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.486907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba31c2808cd466888ef2825a81e446a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.488086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba31c2808cd466888ef2825a81e446a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.501592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c63e2a20-414a-401a-9145-c91b3307dea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba31c2808cd466888ef2825a81e446a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:34.526704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 940/1920] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:34 2022] DELETE /identity/v3/users/eba31c2808cd466888ef2825a81e446a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:34.571589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:35.005259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:35.007779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:35.022259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90513-81e0-452b-bb77-af889092b19f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:35.113721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:35.118849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.119186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.119545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] PATH_INFO: `/v3/projects/a9dcf8a42e6d414f883b48073be14bc8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.121457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9dcf8a42e6d414f883b48073be14bc8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:35.123701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:35.277538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9dcf8a42e6d414f883b48073be14bc8', 'request_id': 'req-ae43ce58-e1f8-4513-91f9-fe287201764f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:35.388824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9dcf8a42e6d414f883b48073be14bc8', 'request_id': 'req-ae43ce58-e1f8-4513-91f9-fe287201764f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:35.394614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9dcf8a42e6d414f883b48073be14bc8', 'request_id': 'req-ae43ce58-e1f8-4513-91f9-fe287201764f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:35.408482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] The token cache is being invalidate because project a9dcf8a42e6d414f883b48073be14bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:35.408899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:35.409864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ae43ce58-e1f8-4513-91f9-fe287201764f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:35.415640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 981/1921] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:35 2022] DELETE /identity/v3/projects/a9dcf8a42e6d414f883b48073be14bc8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:35.417535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.418016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.418107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.436882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:35.438329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:35.527413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 941/1922] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:35.535855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.536446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.536893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.559995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:35.577328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:35.590267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 982/1923] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:35.594473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:35.606937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c12a-1c79-4fe5-830b-c03abab97fce None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:35.612143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:35.613255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.613543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.613821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.615429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:35.615834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:35.618169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:35.634653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 942/1924] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:35.635815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:35.645536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8495-0cbb-45dd-9fe4-d3b3f7570472 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:35.650946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282eaee-6299-4157-b641-f33cadfcbbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:35.651628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282eaee-6299-4157-b641-f33cadfcbbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.651974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282eaee-6299-4157-b641-f33cadfcbbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.652300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282eaee-6299-4157-b641-f33cadfcbbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.653061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282eaee-6299-4157-b641-f33cadfcbbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:35.656536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282eaee-6299-4157-b641-f33cadfcbbbc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:35.792460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 983/1925] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:35 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:35.796676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:35.809701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f507123-bbd1-44c9-a599-cd492cc6e3c6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:35.872793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:35.873619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.873905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.874188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.874888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:35.876851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:35.881318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:35.987037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22986b-0019-4789-a16e-447651d84fc5 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.987541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22986b-0019-4789-a16e-447651d84fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.987912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22986b-0019-4789-a16e-447651d84fc5 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:35.989777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 984/1926] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 13:47:35.995064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 943/1927] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:35 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:35.999316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:35.999629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:35.999903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.002121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.013381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564d9bf-1726-4dbf-ab63-2b46b9096db7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.019594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:36.020212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.021288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:36.021740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.022168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.022600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.023507 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.025959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.038327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 944/1928] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:36.047915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.058479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b6def-0740-4f50-af73-2828bbf21a2e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.063114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.064199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.064199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.064423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.065039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.066932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.069371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:36.077905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 945/1929] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:36.084380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.096264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880a24-33e8-40bb-a95e-45e76033fcd3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.096960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 985/1930] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:36.104140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.105757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.106051 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.106333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] PATH_INFO: `/v3/projects/90d44321169c4b4ea479642baae33ab7/users/749fa4852e1e4434b2e582bf88c0c35a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.112094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.113784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:36.123230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d44321169c4b4ea479642baae33ab7, user_id=749fa4852e1e4434b2e582bf88c0c35a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.125985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.131155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a618e-3a1d-4089-9fbd-7d7bbc5c2cc7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.137503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1c60-cd45-46f6-b5e0-146c77aa06bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.138951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1c60-cd45-46f6-b5e0-146c77aa06bd service placement] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.139375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1c60-cd45-46f6-b5e0-146c77aa06bd service placement] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.139781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1c60-cd45-46f6-b5e0-146c77aa06bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.152034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d1c60-cd45-46f6-b5e0-146c77aa06bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.153865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d1c60-cd45-46f6-b5e0-146c77aa06bd service placement] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.168574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 986/1931] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:36.232111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 946/1932] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:36 2022] PUT /identity/v3/projects/90d44321169c4b4ea479642baae33ab7/users/749fa4852e1e4434b2e582bf88c0c35a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:36.239277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.239495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.239802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.269971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] MFA Rules not processed for user `749fa4852e1e4434b2e582bf88c0c35a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:36.271211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:36.354398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 987/1933] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:36.358962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.426155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497a5cf-5772-4933-ac74-60a99fa46df1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.432404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.433177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.433531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.433888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.434699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.436836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.663524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 947/1934] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:36 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:36.667402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.682156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513101a-8ad5-4375-be19-1141a31a7206 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.824661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.825432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.825782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.826123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.827066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.829964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.925465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 988/1935] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:36 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:36.939453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.950947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba922f55-219d-4aab-9f03-ccdd4f91c5e4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:36.957262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5203-6b34-422f-a034-4c81e7b37dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:36.958726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5203-6b34-422f-a034-4c81e7b37dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:36.959191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5203-6b34-422f-a034-4c81e7b37dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:36.959676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5203-6b34-422f-a034-4c81e7b37dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:36.960644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5203-6b34-422f-a034-4c81e7b37dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:36.962489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5203-6b34-422f-a034-4c81e7b37dc7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:36.977010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 948/1936] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:36.981628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:36.994547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072eb6-7c6c-49ac-b76f-cfaaa1a66c98 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:37.001229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064ccb6-a4f9-4913-abfc-7c09baf42021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:37.005727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064ccb6-a4f9-4913-abfc-7c09baf42021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.006160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064ccb6-a4f9-4913-abfc-7c09baf42021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.006403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064ccb6-a4f9-4913-abfc-7c09baf42021 admin admin] PATH_INFO: `/v3/projects/8940004d6a464eddbc714da79079bc7d/users/ace3c47ba02d4e33a033c86111d3b388/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.028883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064ccb6-a4f9-4913-abfc-7c09baf42021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8940004d6a464eddbc714da79079bc7d, user_id=ace3c47ba02d4e33a033c86111d3b388, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:37.033011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d251-8803-410d-aae7-e86241bf7918 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.033489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d251-8803-410d-aae7-e86241bf7918 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.033962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d251-8803-410d-aae7-e86241bf7918 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.036030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 949/1937] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:47:37.037149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903d251-8803-410d-aae7-e86241bf7918 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:37.039220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7903d251-8803-410d-aae7-e86241bf7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.049101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064ccb6-a4f9-4913-abfc-7c09baf42021 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:37.082726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903d251-8803-410d-aae7-e86241bf7918 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:37.095345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:37.096842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.097231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.097609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] PATH_INFO: `/v3/users/d9e380024c3d400ba01396660f6561ef` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.099757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e380024c3d400ba01396660f6561ef)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:37.101988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:37.147998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 989/1938] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:36 2022] PUT /identity/v3/projects/8940004d6a464eddbc714da79079bc7d/users/ace3c47ba02d4e33a033c86111d3b388/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:37.157413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.157413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.157413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.172583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] MFA Rules not processed for user `f1f97e4500d842ffb91180058af0cbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:37.173812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.225981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:37.254167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 990/1939] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:37.255461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:37.274196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:37.347251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e380024c3d400ba01396660f6561ef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.397125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328d43f-a5c0-4b18-b6bc-a868d8ed8df5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:37.406965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:37.407841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.408239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.408682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.410044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:37.411844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:37.423741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 991/1940] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:37.425488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:37.429225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.429487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e380024c3d400ba01396660f6561ef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.431842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e380024c3d400ba01396660f6561ef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.433105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e380024c3d400ba01396660f6561ef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.441734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e380024c3d400ba01396660f6561ef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.443371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7fb39-ef77-4375-8cc3-61b0bac0a64d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:37.450020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:37.451147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.451610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.451837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] PATH_INFO: `/v3/users/375552a2121144209ffcd2c1e20c7705` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.453279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375552a2121144209ffcd2c1e20c7705)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:37.455718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:37.464116 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 950/1941] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:37 2022] DELETE /identity/v3/users/d9e380024c3d400ba01396660f6561ef => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:37.465408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:37.467033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.544297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef46a7-36fc-4a94-afe7-bcd7ff90bdc7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:37.549812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:37.550476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.550763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.551043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.553811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.565799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:37.567417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:37.578634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 951/1942] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:37.579517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:37.580965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.647074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d89a0c-bd70-4831-8f8b-481066e3bccd service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:37.651819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed7f81-387f-4aa2-b271-d9f80c81da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:37.652809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed7f81-387f-4aa2-b271-d9f80c81da04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.653130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed7f81-387f-4aa2-b271-d9f80c81da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.653406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed7f81-387f-4aa2-b271-d9f80c81da04 admin admin] PATH_INFO: `/v3/projects/8940004d6a464eddbc714da79079bc7d/users/ace3c47ba02d4e33a033c86111d3b388/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.655457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed7f81-387f-4aa2-b271-d9f80c81da04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8940004d6a464eddbc714da79079bc7d, user_id=ace3c47ba02d4e33a033c86111d3b388, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:37.658212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed7f81-387f-4aa2-b271-d9f80c81da04 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:37.664126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375552a2121144209ffcd2c1e20c7705'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.664773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375552a2121144209ffcd2c1e20c7705'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:37.669448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 952/1943] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:37 2022] PUT /identity/v3/projects/8940004d6a464eddbc714da79079bc7d/users/ace3c47ba02d4e33a033c86111d3b388/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:37.678885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a3c8-b4b1-4aa6-a263-028d7441e436 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:37.678885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a3c8-b4b1-4aa6-a263-028d7441e436 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:37.678885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a3c8-b4b1-4aa6-a263-028d7441e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:37.690602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-cec6a3c8-b4b1-4aa6-a263-028d7441e436 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:37.691854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cec6a3c8-b4b1-4aa6-a263-028d7441e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:37.774582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 953/1944] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:38.005522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:38.005522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:38.005522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:38.005522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] MFA Rules not processed for user `ace3c47ba02d4e33a033c86111d3b388`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:38.005522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.005522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 954/1945] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:38.006317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:38.006317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.079315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375552a2121144209ffcd2c1e20c7705'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:38.079953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375552a2121144209ffcd2c1e20c7705'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:38.094103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375552a2121144209ffcd2c1e20c7705'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:38.126304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4134e98-6386-4443-b880-0c25d40090bd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:38.131490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:38.131992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 992/1946] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:37 2022] DELETE /identity/v3/users/375552a2121144209ffcd2c1e20c7705 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:38.133563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:38.135080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:38.135482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:38.135699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:38.135905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.137865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.151111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:38.152617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:38.183197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 955/1947] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:38.245602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1782a84-1e62-4e9c-96de-e1dc860ed6b7 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:38.251123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:38.251881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:38.252315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:38.253315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:38.262435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.371794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:38.373426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:38.387930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 993/1948] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:38.554295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:38.556938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.576655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4b67-6e9a-488c-ba88-90c61202120d service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:38.761069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:38.762197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:38.762475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:38.762803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] PATH_INFO: `/v3/projects/17912dc926e64823b36fb3d47375972a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:38.763957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17912dc926e64823b36fb3d47375972a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:38.765884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:38.801681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:38.892854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:38.917438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17912dc926e64823b36fb3d47375972a', 'request_id': 'req-e15faa7a-5306-4516-9acb-b0c767ac2bc6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:38.922243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:38.924319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:38.925475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17912dc926e64823b36fb3d47375972a', 'request_id': 'req-e15faa7a-5306-4516-9acb-b0c767ac2bc6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:38.941380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfb06b-6605-45f8-99e1-d90543cbc71a service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:39.010685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17912dc926e64823b36fb3d47375972a', 'request_id': 'req-e15faa7a-5306-4516-9acb-b0c767ac2bc6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.029486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] The token cache is being invalidate because project 17912dc926e64823b36fb3d47375972a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:39.030101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.031324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.039049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 956/1949] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:38 2022] DELETE /identity/v3/projects/17912dc926e64823b36fb3d47375972a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:39.041573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:39.041915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:39.042814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:39.043403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:39.043683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] PATH_INFO: `/v3/users/7371da81b15f4c99b9fe08ae026606fb` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:39.045592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:39.046523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7371da81b15f4c99b9fe08ae026606fb)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:39.048658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:39.064497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15faa7a-5306-4516-9acb-b0c767ac2bc6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:39.072361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:39.074260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:39.074608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:39.074894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] PATH_INFO: `/v3/users/117d2186666f4deeab84a4bc34d734d0` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:39.078765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117d2186666f4deeab84a4bc34d734d0)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:39.089182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:39.297984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7371da81b15f4c99b9fe08ae026606fb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.298645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7371da81b15f4c99b9fe08ae026606fb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.357543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117d2186666f4deeab84a4bc34d734d0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.376708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7371da81b15f4c99b9fe08ae026606fb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.377751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7371da81b15f4c99b9fe08ae026606fb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.388880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7371da81b15f4c99b9fe08ae026606fb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.413224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 994/1950] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:38 2022] DELETE /identity/v3/users/7371da81b15f4c99b9fe08ae026606fb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:39.414199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:39.415609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:39.460316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117d2186666f4deeab84a4bc34d734d0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.461786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117d2186666f4deeab84a4bc34d734d0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.463559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:39.464440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117d2186666f4deeab84a4bc34d734d0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.475164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d31ee769-f086-4acb-a7a2-4ed3df0920e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117d2186666f4deeab84a4bc34d734d0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.538356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 957/1951] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:39 2022] DELETE /identity/v3/users/117d2186666f4deeab84a4bc34d734d0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:39.538356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:39.538356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:39.538356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:39.567137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:39.567137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:39.568763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a91be-8f0a-47f3-8425-f1d7fc09420e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:39.670064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:39.671551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:39.672325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:39.672805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] PATH_INFO: `/v3/projects/3dfe97aced0a449fb63fabaf50026cde` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:39.674238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfe97aced0a449fb63fabaf50026cde)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:39.677525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:39.678734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 958/1952] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:39.698113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:39.700923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:39.782936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3807b13-2185-4f21-b5e4-daafe43c9599 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:39.787491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:39.788374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:39.788690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:39.789063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:39.806830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:39.810302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:39.826795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 959/1953] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:39.827016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfe97aced0a449fb63fabaf50026cde', 'request_id': 'req-ed7e05bc-9ea5-4922-a045-2369fa8af386'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.908198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfe97aced0a449fb63fabaf50026cde', 'request_id': 'req-ed7e05bc-9ea5-4922-a045-2369fa8af386'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.918679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfe97aced0a449fb63fabaf50026cde', 'request_id': 'req-ed7e05bc-9ea5-4922-a045-2369fa8af386'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.934295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] The token cache is being invalidate because project 3dfe97aced0a449fb63fabaf50026cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:39.934728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.936451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:39.938458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 995/1954] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:39 2022] DELETE /identity/v3/projects/3dfe97aced0a449fb63fabaf50026cde => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:39.944340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:39.946654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:39.967047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820413e-2404-4a7c-aac4-675cccf194fe service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:40.033365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:40.034439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.034825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.035201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] PATH_INFO: `/v3/users/de510ee8bd974af582867f90625ffa31` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.036697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de510ee8bd974af582867f90625ffa31)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:40.038850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:40.262941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:40.328787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:40.330271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:40.337217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de510ee8bd974af582867f90625ffa31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.349539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e05bc-9ea5-4922-a045-2369fa8af386 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:40.355226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:40.357677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.357677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.357677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] PATH_INFO: `/v3/projects/dfa393e46464434b918e13588b944e2f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.358121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa393e46464434b918e13588b944e2f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:40.359957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:40.411522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de510ee8bd974af582867f90625ffa31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.411522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de510ee8bd974af582867f90625ffa31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.411522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de510ee8bd974af582867f90625ffa31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.420578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-30437788-2326-427a-a81f-40478fa6000a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de510ee8bd974af582867f90625ffa31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.476188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 960/1955] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:39 2022] DELETE /identity/v3/users/de510ee8bd974af582867f90625ffa31 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:40.506478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa393e46464434b918e13588b944e2f', 'request_id': 'req-d99ff1e8-361f-480f-bc86-58afd5ab4f38'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.587174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa393e46464434b918e13588b944e2f', 'request_id': 'req-d99ff1e8-361f-480f-bc86-58afd5ab4f38'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.602394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa393e46464434b918e13588b944e2f', 'request_id': 'req-d99ff1e8-361f-480f-bc86-58afd5ab4f38'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.619639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] The token cache is being invalidate because project dfa393e46464434b918e13588b944e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:40.623704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.623704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d99ff1e8-361f-480f-bc86-58afd5ab4f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:40.623704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 996/1956] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:40 2022] DELETE /identity/v3/projects/dfa393e46464434b918e13588b944e2f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:40.629042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.629042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.629657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.654290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:40.655546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:40.724451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 961/1957] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:40.733174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.733468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.733752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.757243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:40.758619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:40.774394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 997/1958] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:40.776136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:40.787645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5626ca-26c8-4ed3-a4f2-9f4c09a2723f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:40.793146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:40.794250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:40.796631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.796631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.796631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.797728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:40.801139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:40.805769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:40.808734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:40.815987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae2ae7-878b-4037-a7e6-71c0266d1e17 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:40.830702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 962/1959] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:40.833205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:40.833538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:40.835521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.835988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.847100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] PATH_INFO: `/v3/projects/bc2b634a1b814f8e84ce57706d821f06` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.847100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2b634a1b814f8e84ce57706d821f06)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:40.847100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:40.847406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45051501-774c-461d-89b0-e60944b4cf11 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:40.855547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:40.856859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:40.857256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:40.857648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:40.858891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:40.862072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:40.995518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2b634a1b814f8e84ce57706d821f06', 'request_id': 'req-228df4d1-53b6-4679-80e5-3716db0f01f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.048108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 963/1960] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:40 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:41.052700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.121374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc684-c6dd-4900-9551-c8efa7acb5b7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.126178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.126858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.127147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.127430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.128192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.130384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.136722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2b634a1b814f8e84ce57706d821f06', 'request_id': 'req-228df4d1-53b6-4679-80e5-3716db0f01f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.147022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2b634a1b814f8e84ce57706d821f06', 'request_id': 'req-228df4d1-53b6-4679-80e5-3716db0f01f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.192533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] The token cache is being invalidate because project bc2b634a1b814f8e84ce57706d821f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:41.193713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.194422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.196899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 998/1961] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:40 2022] DELETE /identity/v3/projects/bc2b634a1b814f8e84ce57706d821f06 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:41.200745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.202102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:41.277324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228df4d1-53b6-4679-80e5-3716db0f01f2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.284369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.285190 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.291233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.291233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] PATH_INFO: `/v3/projects/553909ac5166487a9cf26f64561b7ee3` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.291233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553909ac5166487a9cf26f64561b7ee3)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.291233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.300483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 964/1962] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:41 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:41.304086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.310069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:41.344066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11481d76-97a3-4f41-a806-e03024b67828 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.351712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:41.360843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.361815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.362156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.362498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] PATH_INFO: `/v3/users/a9e9afa765324f5bbb31920aa54cab9b` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.366077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e9afa765324f5bbb31920aa54cab9b)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.368028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.428490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553909ac5166487a9cf26f64561b7ee3', 'request_id': 'req-e7b9deb3-12cf-4459-b020-59563b8ae381'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.520230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553909ac5166487a9cf26f64561b7ee3', 'request_id': 'req-e7b9deb3-12cf-4459-b020-59563b8ae381'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.529870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553909ac5166487a9cf26f64561b7ee3', 'request_id': 'req-e7b9deb3-12cf-4459-b020-59563b8ae381'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.542174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] The token cache is being invalidate because project 553909ac5166487a9cf26f64561b7ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:41.542451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.543147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.544775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 999/1963] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:41 2022] DELETE /identity/v3/projects/553909ac5166487a9cf26f64561b7ee3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:41.545727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.547377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:41.597305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e9afa765324f5bbb31920aa54cab9b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.622189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9deb3-12cf-4459-b020-59563b8ae381 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.627060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc02aa-9096-444e-b43c-9dab21f826f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.627742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc02aa-9096-444e-b43c-9dab21f826f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.628031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc02aa-9096-444e-b43c-9dab21f826f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.628352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc02aa-9096-444e-b43c-9dab21f826f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.629091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc02aa-9096-444e-b43c-9dab21f826f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.631232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc02aa-9096-444e-b43c-9dab21f826f4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.641447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1000/1964] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:41.642757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.643052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.643317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.663220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:41.664490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:41.667949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e9afa765324f5bbb31920aa54cab9b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.671825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e9afa765324f5bbb31920aa54cab9b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.671825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e9afa765324f5bbb31920aa54cab9b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.678612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-954434a9-71f2-48c8-9212-85163993388b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e9afa765324f5bbb31920aa54cab9b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:41.685125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1001/1965] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:41.685872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.687741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:41.700879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea08c7-3ea4-4e14-ac07-f0550a587fa0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.707030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 965/1966] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:41 2022] DELETE /identity/v3/users/a9e9afa765324f5bbb31920aa54cab9b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:41.707030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.707030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.707030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.711268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.712189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.712480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.712762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.713495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.715408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.733302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1002/1967] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:41.733951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.741375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:41.743061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:41.746849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fbc28-988a-4bc9-8dd8-0e7902c91d8a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.867685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f396a5-4960-40af-b1e7-da8d2009fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.868698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f396a5-4960-40af-b1e7-da8d2009fa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.869058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f396a5-4960-40af-b1e7-da8d2009fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.869417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f396a5-4960-40af-b1e7-da8d2009fa96 admin admin] PATH_INFO: `/v3/projects/2111a0127715460b869e6fd886ce5ab2/users/ee9d2a827a034cf2b5be5ac0c3676cd9/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.872091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 966/1968] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:41.875457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.893206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f396a5-4960-40af-b1e7-da8d2009fa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2111a0127715460b869e6fd886ce5ab2, user_id=ee9d2a827a034cf2b5be5ac0c3676cd9, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.893385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca724c-0865-4b5b-9b00-f2b016d2b29a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.897166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f396a5-4960-40af-b1e7-da8d2009fa96 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.905346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.906555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.907144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.907607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.908438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:41.908750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.910650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:41.930515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 967/1969] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:41.934605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:41.981179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18019d-053b-4cf1-b962-a736d9a3215f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:41.988898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:41.990720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:41.991222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:41.991707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:41.993352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:41.998147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.016847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1003/1970] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:41 2022] PUT /identity/v3/projects/2111a0127715460b869e6fd886ce5ab2/users/ee9d2a827a034cf2b5be5ac0c3676cd9/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:42.028120 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.028600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.028889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.063320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] MFA Rules not processed for user `ee9d2a827a034cf2b5be5ac0c3676cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:42.065211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:42.113806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 968/1971] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:41 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:42.122230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.146805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:42.177330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1004/1972] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:42.199830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.202919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:42.253177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff211c86-63e3-460f-8edb-5425b4fffbd7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.265689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.269642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.269931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.270209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.270981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.276979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.296196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448e6e-9f1f-4e84-b461-dbce2ed9ad1b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.388777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.389745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.390216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.390723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.391384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 969/1973] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:42 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:42.407175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.420889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3691c-4f02-493e-ae9c-259117c2cfe1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.435044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.436401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.437284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.437839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.439002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.448771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.476723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 970/1974] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:42.478030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.509292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d13d-8cee-4585-b686-75764c604247 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.521413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.525441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.525441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.525441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.525441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.525441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.540079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 971/1975] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:42.541300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.547522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:42.547984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.549456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.561271 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2c03-3ac1-4d93-9f38-1b13552f783e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.564554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1005/1976] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:42.564554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.568002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.569059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.569424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.569868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] PATH_INFO: `/v3/projects/e75cbdf70cfd4fd88070a99a9bed7173` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.571939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75cbdf70cfd4fd88070a99a9bed7173)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.574344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.576767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ad4c-e5f5-400c-b682-a835458ce339 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.583135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.584681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.584976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.585257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] PATH_INFO: `/v3/projects/1a9a433bef9e46d1935939a8835e9d21/users/758eb2751d1b4cf1bfa5be147d449689/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.610992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9a433bef9e46d1935939a8835e9d21, user_id=758eb2751d1b4cf1bfa5be147d449689, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.613779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.740169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1006/1977] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:42 2022] PUT /identity/v3/projects/1a9a433bef9e46d1935939a8835e9d21/users/758eb2751d1b4cf1bfa5be147d449689/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:42.748469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75cbdf70cfd4fd88070a99a9bed7173', 'request_id': 'req-0af2808d-4007-4933-950f-782e46998d42'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:42.750660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:42.758518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75cbdf70cfd4fd88070a99a9bed7173', 'request_id': 'req-0af2808d-4007-4933-950f-782e46998d42'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:42.833974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75cbdf70cfd4fd88070a99a9bed7173', 'request_id': 'req-0af2808d-4007-4933-950f-782e46998d42'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:42.850949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7123-6adc-424c-bd9e-7508e9337fd8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:42.853149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] The token cache is being invalidate because project e75cbdf70cfd4fd88070a99a9bed7173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:42.853724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:42.854426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0af2808d-4007-4933-950f-782e46998d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:42.856307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 972/1978] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:42 2022] DELETE /identity/v3/projects/e75cbdf70cfd4fd88070a99a9bed7173 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:42.857382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99ac00-0216-4b8e-a172-14a128f35c74 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.857840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99ac00-0216-4b8e-a172-14a128f35c74 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.858122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99ac00-0216-4b8e-a172-14a128f35c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.892669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5e99ac00-0216-4b8e-a172-14a128f35c74 None None] MFA Rules not processed for user `758eb2751d1b4cf1bfa5be147d449689`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:42.895130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e99ac00-0216-4b8e-a172-14a128f35c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:42.935972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:42.937372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.937840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.938322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] PATH_INFO: `/v3/users/ee9d2a827a034cf2b5be5ac0c3676cd9` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.939601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9d2a827a034cf2b5be5ac0c3676cd9)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:42.942164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:42.977383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 973/1979] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:42.978681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:42.978970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:42.979249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:42.997736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:42.998938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.007642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 974/1980] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:43.008431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.009690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.023781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaeff0-3a18-46b6-817f-949ba06ae1dd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.029231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298004f-3947-41e0-9ea4-4c4501e62c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.029912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298004f-3947-41e0-9ea4-4c4501e62c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.030187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298004f-3947-41e0-9ea4-4c4501e62c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.030468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298004f-3947-41e0-9ea4-4c4501e62c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.031167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298004f-3947-41e0-9ea4-4c4501e62c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.033304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298004f-3947-41e0-9ea4-4c4501e62c88 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.149400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 975/1981] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:43.149400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de9043-67b6-4895-9773-400e875002ce None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.149400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de9043-67b6-4895-9773-400e875002ce None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.149400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de9043-67b6-4895-9773-400e875002ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.162507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9d2a827a034cf2b5be5ac0c3676cd9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:43.163734 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9d2a827a034cf2b5be5ac0c3676cd9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:43.178046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f0de9043-67b6-4895-9773-400e875002ce None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:43.179940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f0de9043-67b6-4895-9773-400e875002ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.268934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 976/1982] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:43.268934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de9043-67b6-4895-9773-400e875002ce None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.279182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de9043-67b6-4895-9773-400e875002ce None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.287817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5756e-46f1-4592-a06c-452b37f50ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.288790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5756e-46f1-4592-a06c-452b37f50ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.289637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5756e-46f1-4592-a06c-452b37f50ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.290286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5756e-46f1-4592-a06c-452b37f50ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.292413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5756e-46f1-4592-a06c-452b37f50ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.295203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5756e-46f1-4592-a06c-452b37f50ff3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.308362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9d2a827a034cf2b5be5ac0c3676cd9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:43.309007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9d2a827a034cf2b5be5ac0c3676cd9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:43.316869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9d2a827a034cf2b5be5ac0c3676cd9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:43.338928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1007/1983] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:42 2022] DELETE /identity/v3/users/ee9d2a827a034cf2b5be5ac0c3676cd9 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:43.339767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.342128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.418798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a81b-a8de-4b58-bcbe-3da0133a1e89 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.424584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 977/1984] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:43.428144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.429174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.429174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.429481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.429598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.429766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.430174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:43.430278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.430534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.432187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.445739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1008/1985] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:43.453122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.453122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.453293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:43.453293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.462890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179675-29d9-45d1-9046-0e6e5cf3ce75 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.466205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 978/1986] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:43.466861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.476630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.476630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.476630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.476630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.477082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.477082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.477526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c7487-6efb-4c87-95a5-fce2a1df8ea3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.483977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.484685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.485296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.485296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.485914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.491902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1009/1987] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:43.492047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.492175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.492902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.551200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f60b6-19cd-4e47-b7c3-1cc30cfa1137 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.554976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.555627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.555906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.556215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.565455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.566892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.576941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1010/1988] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:43.577736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.588454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaea8a6-97b2-4772-80dd-e0f1c1b3ef3b service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.593880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.594621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.594909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.595196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] PATH_INFO: `/v3/projects/1696c3049cbf4ceda90982334919e899/users/33b52abd3bda4600a6c3894c28ff1ea7/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.615454 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1696c3049cbf4ceda90982334919e899, user_id=33b52abd3bda4600a6c3894c28ff1ea7, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.618656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.671538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 979/1989] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:43.675713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.732285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:43.738253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1011/1990] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:43 2022] PUT /identity/v3/projects/1696c3049cbf4ceda90982334919e899/users/33b52abd3bda4600a6c3894c28ff1ea7/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:43.742534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.746770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f599-de81-496c-ae41-6e01741f26f9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.807126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524c4b8-34e5-4d48-b267-0ced0297552e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.813462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.813462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.813462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.813462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.813871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.815551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.830095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1012/1991] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:43.831172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.831879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.832612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.832975 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.833250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.834039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.835884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.853536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ce010-9622-43ed-9fb7-e1db64efb839 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:43.860470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c80b1-ee76-4571-b5e2-0aad9aabe575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:43.862598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c80b1-ee76-4571-b5e2-0aad9aabe575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.862598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c80b1-ee76-4571-b5e2-0aad9aabe575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.862598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c80b1-ee76-4571-b5e2-0aad9aabe575 admin admin] PATH_INFO: `/v3/projects/1696c3049cbf4ceda90982334919e899/users/33b52abd3bda4600a6c3894c28ff1ea7/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.864531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c80b1-ee76-4571-b5e2-0aad9aabe575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1696c3049cbf4ceda90982334919e899, user_id=33b52abd3bda4600a6c3894c28ff1ea7, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:43.867474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c80b1-ee76-4571-b5e2-0aad9aabe575 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:43.882625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1013/1992] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:43 2022] PUT /identity/v3/projects/1696c3049cbf4ceda90982334919e899/users/33b52abd3bda4600a6c3894c28ff1ea7/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:43.893182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:43.893473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:43.893749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:43.921286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 980/1993] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:43.925735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:43.925958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] MFA Rules not processed for user `33b52abd3bda4600a6c3894c28ff1ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:43.927361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:43.941645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ba90d-f5ef-42a7-b7a0-1255fc0af385 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.015913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.016630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.016915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.017223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.017955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.019796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.021023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1014/1994] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:44.032808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.034402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.034521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 981/1995] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:44.035448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.046696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3d40-a17c-47c8-9373-dbf87dbcb8a4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.052143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.052885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.053175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.053457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.054196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.055939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.070375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 982/1996] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:44.071436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.073206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.086716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b0d3-1e09-4798-9522-9ce0dbed5c77 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.091570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.099280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.099280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.099280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] PATH_INFO: `/v3/projects/2111a0127715460b869e6fd886ce5ab2` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.099280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2111a0127715460b869e6fd886ce5ab2)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.099280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.121028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5bea-8fb5-4621-98e1-04a08f6ab7f8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.124928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.125584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.125863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.127351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.137069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.138525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.148786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1015/1997] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:44.150697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.159520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bf353-a769-43d4-9be7-e367d34e164f service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.164502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b34f8c-d665-4004-9de2-700a701b0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.165438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b34f8c-d665-4004-9de2-700a701b0768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.165722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b34f8c-d665-4004-9de2-700a701b0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.165996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b34f8c-d665-4004-9de2-700a701b0768 admin admin] PATH_INFO: `/v3/projects/00e933f81c6447269cd326a21f6bfae8/users/c6c58a628552410ca71175a7bfe458c0/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.182305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b34f8c-d665-4004-9de2-700a701b0768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e933f81c6447269cd326a21f6bfae8, user_id=c6c58a628552410ca71175a7bfe458c0, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.184953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b34f8c-d665-4004-9de2-700a701b0768 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.284582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1016/1998] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:44 2022] PUT /identity/v3/projects/00e933f81c6447269cd326a21f6bfae8/users/c6c58a628552410ca71175a7bfe458c0/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:44.289400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1370f-959e-4549-80d8-7669b7277f91 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.289742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1370f-959e-4549-80d8-7669b7277f91 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.290171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1370f-959e-4549-80d8-7669b7277f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.294436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2111a0127715460b869e6fd886ce5ab2', 'request_id': 'req-1662dfee-6de2-4c34-897f-927b5616088b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.303450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2111a0127715460b869e6fd886ce5ab2', 'request_id': 'req-1662dfee-6de2-4c34-897f-927b5616088b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.323068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-54f1370f-959e-4549-80d8-7669b7277f91 None None] MFA Rules not processed for user `c6c58a628552410ca71175a7bfe458c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:44.324849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-54f1370f-959e-4549-80d8-7669b7277f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.391252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2111a0127715460b869e6fd886ce5ab2', 'request_id': 'req-1662dfee-6de2-4c34-897f-927b5616088b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.403778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] The token cache is being invalidate because project 2111a0127715460b869e6fd886ce5ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:44.404430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.405163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.407033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 983/1999] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:44 2022] DELETE /identity/v3/projects/2111a0127715460b869e6fd886ce5ab2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:44.411563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.413396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.414565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1017/2000] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:44.416093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.416339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.416611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.438787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:44.439921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.493817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662dfee-6de2-4c34-897f-927b5616088b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.498445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.499099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.499385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.499663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.501796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.506430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1018/2001] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:44.507440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.509725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.523719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348ca26-f406-46ec-a447-6a9a6f29cdcc None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.528283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.529129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.529584 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.529935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.531946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.546185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.547629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6676704-1471-4bb7-a129-f8e3ec503e09 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.559923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1019/2002] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:44.561331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.561624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.562197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.593321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:44.598325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:44.599835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.608547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1020/2003] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:44.609366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.615091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:44.620345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.622040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.622261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0228f-9cd2-4654-9c31-79423abd9925 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.626977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.628102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.628244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.628416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] PATH_INFO: `/v3/users/c6c58a628552410ca71175a7bfe458c0` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.630420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c58a628552410ca71175a7bfe458c0)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.632402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.637953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 984/2004] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:44.637953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.649363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7a20-22ac-435d-9c63-5f5ecc6e9f39 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.655425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.656325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.656672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.657252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.658284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:44.658631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.660295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.674277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 985/2005] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:44.678807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.689750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda20fb5-217f-431e-9ce3-7da640621573 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.694988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.695638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.695917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.696223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.696909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.698884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.803476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 986/2006] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:44 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:44.805821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.868741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b83d4-0b11-4371-9e1e-fbd2b2117c6e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:44.873658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:44.874400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:44.874691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:44.874971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:44.875670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:44.877664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:44.888376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c58a628552410ca71175a7bfe458c0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.889091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c58a628552410ca71175a7bfe458c0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.982054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c58a628552410ca71175a7bfe458c0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.982674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c58a628552410ca71175a7bfe458c0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.988258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 987/2007] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:44 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:44.990795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-676e0a4c-188d-4880-ac18-42a221b24737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c58a628552410ca71175a7bfe458c0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:44.996488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:44.996488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.006794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c83e-2533-41c5-b7f8-ac6b5c89d333 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.009895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1021/2008] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:44 2022] DELETE /identity/v3/users/c6c58a628552410ca71175a7bfe458c0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:45.011604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.012298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.012586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.013136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.013864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.014279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.014596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.014877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.015459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.028658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 988/2009] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:45.031997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.032329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:45.033530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.041798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90653e9-c179-4498-bb5b-d59581b7afd1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.104997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.105697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.114438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.114438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.114438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.114703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1022/2010] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:45.114780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.123893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.125443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.129358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 989/2011] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:45.131475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.142221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bbe9c-7d70-44d7-ac73-af2e529080f3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.147947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.148896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.149181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.149478 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] PATH_INFO: `/v3/projects/01f4fb2e8761497680b2d6a99961cd30/users/b67ce71100ed4111bbb01660f407068b/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.165987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f4fb2e8761497680b2d6a99961cd30, user_id=b67ce71100ed4111bbb01660f407068b, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.168872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.185905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ee5d-3564-4241-bdcf-576aa1dbc370 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.190790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f58b9f-45f7-4489-9a16-abbe2489c64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.194716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f58b9f-45f7-4489-9a16-abbe2489c64c service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.194716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f58b9f-45f7-4489-9a16-abbe2489c64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.194716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f58b9f-45f7-4489-9a16-abbe2489c64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.203328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f58b9f-45f7-4489-9a16-abbe2489c64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.204819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f58b9f-45f7-4489-9a16-abbe2489c64c service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.215006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1023/2012] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:45.279555 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 990/2013] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:45 2022] PUT /identity/v3/projects/01f4fb2e8761497680b2d6a99961cd30/users/b67ce71100ed4111bbb01660f407068b/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:45.291829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.292158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.292466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.322246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] MFA Rules not processed for user `b67ce71100ed4111bbb01660f407068b`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:45.323777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.414895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1024/2014] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:45.419463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.505537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c976ad2-aa8d-4f3a-93d7-b5fa2c79223b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.515212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.515957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.516286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.516642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.517378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.519296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.526383 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.527829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.544653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557383bf-9206-4156-ad2a-3fd35bd5e3f8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.549449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.550328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.550604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.550899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] PATH_INFO: `/v3/users/758eb2751d1b4cf1bfa5be147d449689` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.552188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=758eb2751d1b4cf1bfa5be147d449689)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.554279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.679913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 991/2015] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:45 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:45.683725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.756522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a889c-3342-4b3f-924b-7268f9b82534 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.762090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.762797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.763080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.763356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.764070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.766030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.786762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758eb2751d1b4cf1bfa5be147d449689'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:45.787518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758eb2751d1b4cf1bfa5be147d449689'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:45.845341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 992/2016] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:45 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:45.846185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.848008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.859826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676fe7f-1419-4a1f-917e-d52c5176e1d7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.861976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758eb2751d1b4cf1bfa5be147d449689'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:45.862773 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758eb2751d1b4cf1bfa5be147d449689'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:45.866624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:45.867535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:45.868378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:45.868378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] PATH_INFO: `/v3/projects/00e933f81c6447269cd326a21f6bfae8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:45.869329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e933f81c6447269cd326a21f6bfae8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:45.871379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:45.871616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758eb2751d1b4cf1bfa5be147d449689'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:45.894014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1025/2017] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:45 2022] DELETE /identity/v3/users/758eb2751d1b4cf1bfa5be147d449689 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:45.897326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:45.897326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:45.960381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f9b2-c104-4559-b039-a4a25e6ed3d4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:45.975535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e933f81c6447269cd326a21f6bfae8', 'request_id': 'req-cc713a78-df79-4de2-92a0-63fffcfe8675'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:45.981745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e933f81c6447269cd326a21f6bfae8', 'request_id': 'req-cc713a78-df79-4de2-92a0-63fffcfe8675'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:46.016318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499d4b2-8317-4ed6-83db-0ce8b1bb3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.016995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499d4b2-8317-4ed6-83db-0ce8b1bb3b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.017279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499d4b2-8317-4ed6-83db-0ce8b1bb3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.017610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499d4b2-8317-4ed6-83db-0ce8b1bb3b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.018360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499d4b2-8317-4ed6-83db-0ce8b1bb3b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.019986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499d4b2-8317-4ed6-83db-0ce8b1bb3b20 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.031487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1026/2018] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:46.031487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.031487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.035465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.049038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:46.050232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.058961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1027/2019] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:46.059704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.068258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e933f81c6447269cd326a21f6bfae8', 'request_id': 'req-cc713a78-df79-4de2-92a0-63fffcfe8675'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:46.069228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be064b9-1355-4728-b3e1-53413aa9ff03 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.074129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdff288-174d-4ed3-844e-33db7d60fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.075018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdff288-174d-4ed3-844e-33db7d60fc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.075690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdff288-174d-4ed3-844e-33db7d60fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.075690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdff288-174d-4ed3-844e-33db7d60fc2f admin admin] PATH_INFO: `/v3/projects/0b8c1f5a34a142d8b92205d60bff6998/users/16f14911c8ad4959bb9cf63f74da879e/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.079322 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] The token cache is being invalidate because project 00e933f81c6447269cd326a21f6bfae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:46.079615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:46.080315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:46.081880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 993/2020] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:45 2022] DELETE /identity/v3/projects/00e933f81c6447269cd326a21f6bfae8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:46.082808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.084932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.090935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdff288-174d-4ed3-844e-33db7d60fc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8c1f5a34a142d8b92205d60bff6998, user_id=16f14911c8ad4959bb9cf63f74da879e, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.093716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdff288-174d-4ed3-844e-33db7d60fc2f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.150126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc713a78-df79-4de2-92a0-63fffcfe8675 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.153798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.154469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.154748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.155020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.156853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.168914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.170315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.177242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1028/2021] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:46 2022] PUT /identity/v3/projects/0b8c1f5a34a142d8b92205d60bff6998/users/16f14911c8ad4959bb9cf63f74da879e/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:46.178690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0dfa-f9f4-4889-aea2-32193cc430c1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.178980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0dfa-f9f4-4889-aea2-32193cc430c1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.179259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0dfa-f9f4-4889-aea2-32193cc430c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.183487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 994/2022] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:46.184350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.185893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.197594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c5cf0dfa-f9f4-4889-aea2-32193cc430c1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:46.198325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4b8e5-136a-4a20-aa4d-e800417b75f6 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.198795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c5cf0dfa-f9f4-4889-aea2-32193cc430c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.262595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1029/2023] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:46.270170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.276724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.276724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.277115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.277210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.277301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.277301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.277301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.277301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.287963 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 995/2024] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:46.290398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:46.291607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.291873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.299714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1030/2025] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:46.304077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.304790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ff89-4447-489f-a756-25b7f25a91fd admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.307682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:46.318353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.318353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.318353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.318353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] PATH_INFO: `/v3/projects/0b8c1f5a34a142d8b92205d60bff6998/users/16f14911c8ad4959bb9cf63f74da879e/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.318783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45488fbe-f5e6-4166-a28c-c4d13f12258d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.318882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8c1f5a34a142d8b92205d60bff6998, user_id=16f14911c8ad4959bb9cf63f74da879e, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.318969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.319343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.319606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.319989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.320740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:46.321042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.322475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.322603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8276334-aa80-4eb3-b29e-209ffbe35168 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.333738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 996/2026] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:46 2022] PUT /identity/v3/projects/0b8c1f5a34a142d8b92205d60bff6998/users/16f14911c8ad4959bb9cf63f74da879e/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:46.336364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1031/2027] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:47:46.340403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.343901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.344434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.344923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.377633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:46.398702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] MFA Rules not processed for user `16f14911c8ad4959bb9cf63f74da879e`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:46.398702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.450300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616bd47-fe54-4fe2-bae7-1549f1a1896f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.491917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.492720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.493010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.493281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.494006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.497442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.522585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1032/2028] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:46.532328 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.534143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.616940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467add-fd58-43bf-a9a4-60fe0c785e88 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.625604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.626596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.627067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.627670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.630010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.632847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 997/2029] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:46 2022] POST /identity/v3/projects => generated 371 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:46.637106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.698732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.705936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.706071 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7375-0cd6-4ec1-b82b-6f6bde8bf3f7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.709655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.710329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.710624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.710906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.711745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.713425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1033/2030] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:46.713735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.733565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.735510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:46.753367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2deb91-a9f7-4434-9c79-ea7bbc81a2b7 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.760586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.761727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.762077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.762596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] PATH_INFO: `/v3/projects/1a9a433bef9e46d1935939a8835e9d21` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.763871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9a433bef9e46d1935939a8835e9d21)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.766259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.798388 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 998/2031] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:46 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:46.802924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.815237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f12fe2-2fee-4264-bfb5-9b4ca2ac4d38 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.821967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.822799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.832162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.832162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.832162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.832162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.838763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 999/2032] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:46.844681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.855667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee147-d5b9-4467-8b9e-fe7585a510e3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.860728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.861513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.861965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.862301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:46.868244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:46.868244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:46.881919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1000/2033] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:46.886231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:46.908392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27bbe-8e63-490f-b636-44a09dc58b11 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:46.936305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9a433bef9e46d1935939a8835e9d21', 'request_id': 'req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:46.981377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c158bc-9338-4cfa-b291-27f812d69c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:46.982342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c158bc-9338-4cfa-b291-27f812d69c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:46.982633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c158bc-9338-4cfa-b291-27f812d69c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:46.982911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c158bc-9338-4cfa-b291-27f812d69c56 admin admin] PATH_INFO: `/v3/projects/988cc5a3101e48e9b3820a3258789aab/users/6bea631754c04668a92e99b6bb40337e/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:47.007041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c158bc-9338-4cfa-b291-27f812d69c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988cc5a3101e48e9b3820a3258789aab, user_id=6bea631754c04668a92e99b6bb40337e, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:47.010882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c158bc-9338-4cfa-b291-27f812d69c56 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:47.027472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9a433bef9e46d1935939a8835e9d21', 'request_id': 'req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.042394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9a433bef9e46d1935939a8835e9d21', 'request_id': 'req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.072091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] The token cache is being invalidate because project 1a9a433bef9e46d1935939a8835e9d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:47.072411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.073652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.074665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1034/2034] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:46 2022] DELETE /identity/v3/projects/1a9a433bef9e46d1935939a8835e9d21 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:47.079279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:47.082844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:47.108467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1001/2035] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:46 2022] PUT /identity/v3/projects/988cc5a3101e48e9b3820a3258789aab/users/6bea631754c04668a92e99b6bb40337e/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:47.121823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:47.121823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:47.122041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:47.125948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce9bdb-4e9b-442a-95fb-1a4fae75f42a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:47.158465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] MFA Rules not processed for user `6bea631754c04668a92e99b6bb40337e`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:47.160202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:47.219084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:47.220083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:47.220395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:47.220655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] PATH_INFO: `/v3/users/33b52abd3bda4600a6c3894c28ff1ea7` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:47.222173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b52abd3bda4600a6c3894c28ff1ea7)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:47.224475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:47.252405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1002/2036] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:47.264594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:47.266005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:47.323574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc068f9c-b14c-4b3b-abc9-221d6b9bc5b1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:47.327468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:47.328314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:47.328631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:47.328937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:47.338653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:47.340253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:47.349580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1003/2037] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:47.475350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b52abd3bda4600a6c3894c28ff1ea7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.476039 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b52abd3bda4600a6c3894c28ff1ea7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.577057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b52abd3bda4600a6c3894c28ff1ea7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.577701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b52abd3bda4600a6c3894c28ff1ea7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.587488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-de8824d6-5194-49d9-8c2a-c367bd3c7f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b52abd3bda4600a6c3894c28ff1ea7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:47.614376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1035/2038] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:47 2022] DELETE /identity/v3/users/33b52abd3bda4600a6c3894c28ff1ea7 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:48.099232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:48.115700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d24b5-1fdc-4e60-b272-f135cd6bbfb8 service glance] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:48.187211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:48.188287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.188576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.188858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] PATH_INFO: `/v3/projects/1696c3049cbf4ceda90982334919e899` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.190656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1696c3049cbf4ceda90982334919e899)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:48.193588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:48.300778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:48.321933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1696c3049cbf4ceda90982334919e899', 'request_id': 'req-7253d03e-a035-4149-9334-226e7f50a7fa'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:48.328895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1696c3049cbf4ceda90982334919e899', 'request_id': 'req-7253d03e-a035-4149-9334-226e7f50a7fa'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:48.444979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1696c3049cbf4ceda90982334919e899', 'request_id': 'req-7253d03e-a035-4149-9334-226e7f50a7fa'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:48.456844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] The token cache is being invalidate because project 1696c3049cbf4ceda90982334919e899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:48.457134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:48.457957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7253d03e-a035-4149-9334-226e7f50a7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:48.459526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1004/2039] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:48 2022] DELETE /identity/v3/projects/1696c3049cbf4ceda90982334919e899 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:48.464384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.464888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.464979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.484741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:48.486005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:48.546594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1036/2040] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:48.555233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.555529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.555817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.574955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:48.576280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:48.585496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1005/2041] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:48.589668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:48.600468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a88541-9a78-4abf-bb18-a12c56cdeb5c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:48.605341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:48.606044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.606330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.606606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.607338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:48.607650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:48.609294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:48.622880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1037/2042] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:48.627209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:48.637366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d93a0-3184-489d-adb2-1d29319227fb None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:48.642802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:48.643473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.643758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.644150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.644771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:48.646666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:48.758314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1006/2043] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:48 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:48.762446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:48.773234 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0d040-a48d-4fd5-9854-7b2882afb08f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:48.829799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:48.830591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.830876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.831172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.831844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:48.835130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:48.968435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1038/2044] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:48 2022] POST /identity/v3/users => generated 280 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:48.975998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:48.986626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62a5f-a216-4d98-9dc1-add07398af41 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:48.994413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:48.995215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:48.995496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:48.995772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:48.996553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:48.999592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:49.013476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1007/2045] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:49.014467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:49.025081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65284f6-2e75-4300-90ac-6f0ad3ffda31 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:49.029947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbef1b8-76e5-43a0-96b6-468dd17581d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:49.030609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbef1b8-76e5-43a0-96b6-468dd17581d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:49.030891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbef1b8-76e5-43a0-96b6-468dd17581d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:49.031165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbef1b8-76e5-43a0-96b6-468dd17581d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:49.031884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbef1b8-76e5-43a0-96b6-468dd17581d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:49.033529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbef1b8-76e5-43a0-96b6-468dd17581d7 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:49.047748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1039/2046] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:49.051385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:49.059253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087655-3eb0-4de3-bdd0-34f7078646ee admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:49.063758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:49.064698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:49.065005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:49.065279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] PATH_INFO: `/v3/projects/a09f29ccb5244cc09b0c6386049e9937/users/d17aae6cba7c431ea90e8b51e505bf8a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:49.081623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09f29ccb5244cc09b0c6386049e9937, user_id=d17aae6cba7c431ea90e8b51e505bf8a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:49.084738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:49.187259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1008/2047] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:49 2022] PUT /identity/v3/projects/a09f29ccb5244cc09b0c6386049e9937/users/d17aae6cba7c431ea90e8b51e505bf8a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:49.199329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd57f-487d-4540-844c-87c32a557036 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:49.199757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd57f-487d-4540-844c-87c32a557036 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:49.200085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd57f-487d-4540-844c-87c32a557036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:49.209461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:49.230461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-355fd57f-487d-4540-844c-87c32a557036 None None] MFA Rules not processed for user `d17aae6cba7c431ea90e8b51e505bf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:49.231745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-355fd57f-487d-4540-844c-87c32a557036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:49.304953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1040/2048] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:49.338910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:49.340742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:49.413763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941e366-8722-4767-95c1-6c1a90d8d6aa admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:49.423513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7d4c-010f-40dc-86c7-2ab31585149c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:49.423513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7d4c-010f-40dc-86c7-2ab31585149c service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:49.423513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7d4c-010f-40dc-86c7-2ab31585149c service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:49.423513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7d4c-010f-40dc-86c7-2ab31585149c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:49.433652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7d4c-010f-40dc-86c7-2ab31585149c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:49.435656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7d4c-010f-40dc-86c7-2ab31585149c service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:49.449670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1009/2049] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:49.464390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd57f-487d-4540-844c-87c32a557036 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:49.563954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd57f-487d-4540-844c-87c32a557036 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:49.571500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:49.573832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:49.574036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:49.574265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] PATH_INFO: `/v3/users/d17aae6cba7c431ea90e8b51e505bf8a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:49.577638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17aae6cba7c431ea90e8b51e505bf8a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:49.578673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:49.791799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17aae6cba7c431ea90e8b51e505bf8a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:49.792472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17aae6cba7c431ea90e8b51e505bf8a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:49.882863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17aae6cba7c431ea90e8b51e505bf8a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:49.882863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17aae6cba7c431ea90e8b51e505bf8a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:49.889085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17aae6cba7c431ea90e8b51e505bf8a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:49.909710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1041/2050] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:49 2022] DELETE /identity/v3/users/d17aae6cba7c431ea90e8b51e505bf8a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:49.920259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:49.920599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:49.920899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:49.939286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:49.940679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.000606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1010/2051] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:50.010736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:50.012160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.074196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3359aa-3bb7-44c8-a7e8-36bd1f4e629b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:50.078107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:50.078761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:50.079045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:50.079318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:50.090169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:50.091686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:50.102476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1042/2052] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:50.168790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:50.264247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:50.265660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.277676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8ca91-d7c8-4cb6-bffe-6e21ad53e7f0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:50.282293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:50.283163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:50.283449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:50.283729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] PATH_INFO: `/v3/users/b67ce71100ed4111bbb01660f407068b` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:50.284956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67ce71100ed4111bbb01660f407068b)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:50.287070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:50.549411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:50.550970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.562950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67ce71100ed4111bbb01660f407068b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.576196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aaedb-2a18-452e-bf45-3dc8d7d8fd7d service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:50.581191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:50.587743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:50.587743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:50.587743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] PATH_INFO: `/v3/projects/a09f29ccb5244cc09b0c6386049e9937` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:50.587743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09f29ccb5244cc09b0c6386049e9937)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:50.587743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:50.648420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67ce71100ed4111bbb01660f407068b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.649219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67ce71100ed4111bbb01660f407068b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.649847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67ce71100ed4111bbb01660f407068b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.657731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ffd69b17-d997-4008-a5f8-2c5d3bbf0f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67ce71100ed4111bbb01660f407068b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.684387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1011/2053] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:50 2022] DELETE /identity/v3/users/b67ce71100ed4111bbb01660f407068b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:50.688855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:50.689221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:50.689575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:50.712844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:50.714144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.773124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09f29ccb5244cc09b0c6386049e9937', 'request_id': 'req-d149e879-f50e-4d73-bbd3-dc7c5259b415'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.781935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1012/2054] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:50.782147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:50.793575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:50.795441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.839177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09f29ccb5244cc09b0c6386049e9937', 'request_id': 'req-d149e879-f50e-4d73-bbd3-dc7c5259b415'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.847198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09f29ccb5244cc09b0c6386049e9937', 'request_id': 'req-d149e879-f50e-4d73-bbd3-dc7c5259b415'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.861223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] The token cache is being invalidate because project a09f29ccb5244cc09b0c6386049e9937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:50.861223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.861513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d149e879-f50e-4d73-bbd3-dc7c5259b415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:50.862373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81170-3fc0-4c95-91fd-4d0915c34228 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:50.863101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1043/2055] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:50 2022] DELETE /identity/v3/projects/a09f29ccb5244cc09b0c6386049e9937 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:50.870005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:50.870289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:50.870589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:50.900791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:50.902060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.919129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:50.919779 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:50.920078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:50.920565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:50.922320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:50.985609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1044/2056] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:50.987984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:50.990009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.011536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f29d9e-3214-4d6c-83ee-eb67cf20423d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.013024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.013024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3fc74-f5f3-4ace-93d5-d4e29e4e5802 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.016994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.018026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.018412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.018790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] PATH_INFO: `/v3/users/749fa4852e1e4434b2e582bf88c0c35a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.020687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749fa4852e1e4434b2e582bf88c0c35a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.022872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.025195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1013/2057] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:51.031140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.031140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.031140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.077277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:51.078684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.105832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1014/2058] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:51.108690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.117924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cb014-c776-4b42-bddc-aef62e2eb9ca None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.122539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.123239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.123515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.123794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.124582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:51.124894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.126510 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.139337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1015/2059] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:47:51.143536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.154806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc547fa-35d7-4743-9e14-8ef4d6e37ddb admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.159475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.160164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.160482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.161288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.162151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.164109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.245197 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749fa4852e1e4434b2e582bf88c0c35a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.245925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749fa4852e1e4434b2e582bf88c0c35a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.267792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1016/2060] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:51 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:51.272585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.320787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749fa4852e1e4434b2e582bf88c0c35a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.323583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749fa4852e1e4434b2e582bf88c0c35a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.333676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-93b36bd5-bcc8-4338-a00f-62eca0a5e250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749fa4852e1e4434b2e582bf88c0c35a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.337821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01155668-553b-440f-9fef-1712a1195620 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.342761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.343427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.343886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.344203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.344901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.347170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.351613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1045/2061] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:50 2022] DELETE /identity/v3/users/749fa4852e1e4434b2e582bf88c0c35a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:51.355862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.356180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.356461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.361308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:51.374019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:51.375352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.452693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1046/2062] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:51.466273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1017/2063] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:51 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:51.470216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.472813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.475006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.479732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.501208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9402e5-d441-4b5b-b388-75335da851a1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.520250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.521911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.522523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.523017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.524358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.527269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.548568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1018/2064] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:51.549787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5acf1-439a-436f-b52a-c330d203ccab None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.553101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.555040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.556294 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.556581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.556875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.573470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c8fba-fa0c-443e-9e0a-dbf858dbdcc4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.576597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.579144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.585463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.586790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.587078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.587356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.588491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.590514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.595448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1047/2065] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:51.606297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1019/2066] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:51.611053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.621919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13d4aa-6d57-41a3-a2d2-43de913513b7 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.634385 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739e67d-fb3a-4112-b3be-10ba36ad2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.635697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739e67d-fb3a-4112-b3be-10ba36ad2637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.636066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739e67d-fb3a-4112-b3be-10ba36ad2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.636472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739e67d-fb3a-4112-b3be-10ba36ad2637 admin admin] PATH_INFO: `/v3/projects/8f23b2321e8d43699d3ca9c1addd715b/users/f0da90c1092b43df9163b6bb9d6743cd/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.643085 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:51.654352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739e67d-fb3a-4112-b3be-10ba36ad2637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f23b2321e8d43699d3ca9c1addd715b, user_id=f0da90c1092b43df9163b6bb9d6743cd, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.657182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739e67d-fb3a-4112-b3be-10ba36ad2637 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.675369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.679124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.700748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b797d-5a2c-45b4-9161-f99628c4d411 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:51.716718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:51.717625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.717930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.718204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] PATH_INFO: `/v3/projects/01f4fb2e8761497680b2d6a99961cd30` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.720952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f4fb2e8761497680b2d6a99961cd30)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:51.727217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:51.770725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1048/2067] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:51 2022] PUT /identity/v3/projects/8f23b2321e8d43699d3ca9c1addd715b/users/f0da90c1092b43df9163b6bb9d6743cd/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:51.771477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:51.771764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:51.772046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:51.801985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] MFA Rules not processed for user `f0da90c1092b43df9163b6bb9d6743cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:51.803246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.878167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1049/2068] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:51.889978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:51.891695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:51.931789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f4fb2e8761497680b2d6a99961cd30', 'request_id': 'req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.940903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f4fb2e8761497680b2d6a99961cd30', 'request_id': 'req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:51.956136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:51.986060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c983-496b-468d-a39a-fc57064b9671 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:52.005262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f4fb2e8761497680b2d6a99961cd30', 'request_id': 'req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.017427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] The token cache is being invalidate because project 01f4fb2e8761497680b2d6a99961cd30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:52.017729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.018383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.020291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1020/2069] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:51 2022] DELETE /identity/v3/projects/01f4fb2e8761497680b2d6a99961cd30 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:52.021096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:52.022523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:52.046532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:52.047280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:52.047673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:52.048023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:52.049938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:52.112870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d45df-7a17-4ba9-a7e8-86abac9f8069 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:52.118164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:52.119050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:52.120781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:52.120781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] PATH_INFO: `/v3/users/8fd00cf03b884d8999591ae4db0c1bc5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:52.120781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd00cf03b884d8999591ae4db0c1bc5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:52.122712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:52.126986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:52.128621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:52.138519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1050/2070] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:52.139402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:52.140865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:52.155212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fad1a-4405-4f88-ab42-5c41012d5efe service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:52.160539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:52.161770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:52.162086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:52.162368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] PATH_INFO: `/v3/users/16f14911c8ad4959bb9cf63f74da879e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:52.163587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f14911c8ad4959bb9cf63f74da879e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:52.165597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:52.301831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd00cf03b884d8999591ae4db0c1bc5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.362119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd00cf03b884d8999591ae4db0c1bc5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.362856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd00cf03b884d8999591ae4db0c1bc5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.364091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd00cf03b884d8999591ae4db0c1bc5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.373216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd00cf03b884d8999591ae4db0c1bc5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.373612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:52.381450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f14911c8ad4959bb9cf63f74da879e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.382098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f14911c8ad4959bb9cf63f74da879e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.392867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1021/2071] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:52 2022] DELETE /identity/v3/users/8fd00cf03b884d8999591ae4db0c1bc5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:52.393831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:52.395275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:52.465471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f14911c8ad4959bb9cf63f74da879e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.466382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f14911c8ad4959bb9cf63f74da879e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.468922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051ec8f-880d-4cb1-bc45-31694d678ded admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:52.476026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:52.476026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:52.476026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:52.476344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f14911c8ad4959bb9cf63f74da879e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.476550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] PATH_INFO: `/v3/projects/90d44321169c4b4ea479642baae33ab7` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:52.477852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d44321169c4b4ea479642baae33ab7)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:52.479927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:52.501431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1051/2072] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:52 2022] DELETE /identity/v3/users/16f14911c8ad4959bb9cf63f74da879e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:52.617368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d44321169c4b4ea479642baae33ab7', 'request_id': 'req-c03af52f-82a2-4a3a-82bb-352bc69626e4'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.623492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d44321169c4b4ea479642baae33ab7', 'request_id': 'req-c03af52f-82a2-4a3a-82bb-352bc69626e4'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.732926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:52.734997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:52.759501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d44321169c4b4ea479642baae33ab7', 'request_id': 'req-c03af52f-82a2-4a3a-82bb-352bc69626e4'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.763716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:52.776890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] The token cache is being invalidate because project 90d44321169c4b4ea479642baae33ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:52.778680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.780309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:52.784336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1022/2073] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:52 2022] DELETE /identity/v3/projects/90d44321169c4b4ea479642baae33ab7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:52.792315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:52.792315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:52.852202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28c348-a020-43c2-931b-cac7bb3f157c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:52.928015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af52f-82a2-4a3a-82bb-352bc69626e4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:52.936419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:52.937497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:52.937788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:52.938179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] PATH_INFO: `/v3/users/ace3c47ba02d4e33a033c86111d3b388` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:52.945609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace3c47ba02d4e33a033c86111d3b388)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:52.948375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:52.959655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:52.960715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:52.961098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:52.962049 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] PATH_INFO: `/v3/projects/9e6598a073a442958076b48bed28c472` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:52.963347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6598a073a442958076b48bed28c472)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:52.965311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.074403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:53.198108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6598a073a442958076b48bed28c472', 'request_id': 'req-7e0cfe9c-6dbd-442b-a5de-603ed126abda'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.198987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace3c47ba02d4e33a033c86111d3b388'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.273031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6598a073a442958076b48bed28c472', 'request_id': 'req-7e0cfe9c-6dbd-442b-a5de-603ed126abda'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.278817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6598a073a442958076b48bed28c472', 'request_id': 'req-7e0cfe9c-6dbd-442b-a5de-603ed126abda'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.290723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] The token cache is being invalidate because project 9e6598a073a442958076b48bed28c472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:53.291009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.291641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.293313 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1052/2074] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:52 2022] DELETE /identity/v3/projects/9e6598a073a442958076b48bed28c472 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:53.294157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.295470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.339046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace3c47ba02d4e33a033c86111d3b388'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.339782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace3c47ba02d4e33a033c86111d3b388'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.341035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace3c47ba02d4e33a033c86111d3b388'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.349355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a53ec300-1b10-4d82-a684-ee71c4605876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace3c47ba02d4e33a033c86111d3b388'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.359784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cfe9c-6dbd-442b-a5de-603ed126abda admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:53.364661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:53.365570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.365855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.366133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] PATH_INFO: `/v3/projects/0b8c1f5a34a142d8b92205d60bff6998` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.367000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1023/2075] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:52 2022] DELETE /identity/v3/users/ace3c47ba02d4e33a033c86111d3b388 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:53.370646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8c1f5a34a142d8b92205d60bff6998)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:53.370858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0957e95-5085-4d32-8823-24f1aedf8aa5 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.370858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0957e95-5085-4d32-8823-24f1aedf8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.370858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0957e95-5085-4d32-8823-24f1aedf8aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.371099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.387579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e0957e95-5085-4d32-8823-24f1aedf8aa5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:53.388878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e0957e95-5085-4d32-8823-24f1aedf8aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.456937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1024/2076] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:53.475382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.475670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.475950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.494251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:53.495450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.505992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8c1f5a34a142d8b92205d60bff6998', 'request_id': 'req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.556498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1025/2077] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:53.560502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.569882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f3e0e-4b2f-4ae9-9406-ab82c9a88c87 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:53.574452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:53.575082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.575365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.575642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.576407 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:53.576716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:53.578462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.592089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1026/2078] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:47:53.600918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.610848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1cd2-82ac-446f-966a-6cadb6b1ad10 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:53.615678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:53.616379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.616661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.616938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.617692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:53.619718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8c1f5a34a142d8b92205d60bff6998', 'request_id': 'req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.620009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.627350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8c1f5a34a142d8b92205d60bff6998', 'request_id': 'req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.640557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] The token cache is being invalidate because project 0b8c1f5a34a142d8b92205d60bff6998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:53.640845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.641535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-49fdc3e9-fbc4-407d-9ce9-115cad3cc1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:53.647549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1053/2079] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:53 2022] DELETE /identity/v3/projects/0b8c1f5a34a142d8b92205d60bff6998 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:53.649046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd7f6-0bcf-496d-a850-466ac69c9a13 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.649323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd7f6-0bcf-496d-a850-466ac69c9a13 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.649600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd7f6-0bcf-496d-a850-466ac69c9a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.672460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ef1fd7f6-0bcf-496d-a850-466ac69c9a13 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:53.673736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ef1fd7f6-0bcf-496d-a850-466ac69c9a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.683462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1054/2080] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:53.691062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.691411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.692324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.710741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:53.712701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.724500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1055/2081] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:53.728550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.737520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9bdcf-e8fc-47e1-9643-83cf36faae53 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:53.743112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:53.743768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.744047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.744351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.745071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:53.745381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:53.747050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.755652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:53.760920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1056/2082] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:47:53.768918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.777816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1027/2083] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/projects => generated 357 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:53.780187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a05bef-63e4-44e8-bddb-31c3f887bbe2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:53.781339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.782994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.837770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:53.838434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.838711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.838984 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.839737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:53.841622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.849065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f41d7-ef79-4381-9f2f-19b29caaa820 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:53.853967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:53.854683 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:53.854982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:53.855255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:53.855954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:53.857917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:53.972396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1057/2084] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:53.973949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.975872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:53.996591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1028/2085] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/users => generated 279 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:53.997952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:53.999485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:54.010956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586edb6-2595-4c09-9889-5743deda9afc admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.061643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6b50d-9e45-4f76-8099-663db132403f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.067707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.068723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.069104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.069479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] PATH_INFO: `/v3/projects/8940004d6a464eddbc714da79079bc7d` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.070743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8940004d6a464eddbc714da79079bc7d)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.071059 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.071770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.072048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.072358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.073044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.073523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.074926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.156333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1029/2086] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:53 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:54.156333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.164694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971f845-92b2-4c1b-a938-27614624f69f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.169408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.170062 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.170346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.170626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.171345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.173005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.183960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1030/2087] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:54.184880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.197881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14f65-dd7f-488d-93dc-8b99fa5ab584 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.203641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.204532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.204847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.205124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.205861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.208133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.218438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8940004d6a464eddbc714da79079bc7d', 'request_id': 'req-d3886334-2cde-457a-be7e-8e2c9ddebd43'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:54.222385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1031/2088] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:54.222385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.237979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeacbd8-49d8-475d-8062-7c73c0a475d9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.302601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.303310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.303598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.303869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.304694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.306330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.310350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8940004d6a464eddbc714da79079bc7d', 'request_id': 'req-d3886334-2cde-457a-be7e-8e2c9ddebd43'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:54.316330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1032/2089] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:54.318570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8940004d6a464eddbc714da79079bc7d', 'request_id': 'req-d3886334-2cde-457a-be7e-8e2c9ddebd43'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:54.320756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.330524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85611581-850f-4e15-bff7-2499b4d8a958 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.331607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] The token cache is being invalidate because project 8940004d6a464eddbc714da79079bc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:54.331865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:54.333346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:54.335162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1058/2090] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:53 2022] DELETE /identity/v3/projects/8940004d6a464eddbc714da79079bc7d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:54.336663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dbe14-9adb-48e0-bdb8-b0a3295c1de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.337334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbe14-9adb-48e0-bdb8-b0a3295c1de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.338283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbe14-9adb-48e0-bdb8-b0a3295c1de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.338579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbe14-9adb-48e0-bdb8-b0a3295c1de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.339432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dbe14-9adb-48e0-bdb8-b0a3295c1de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.340696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.340968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dbe14-9adb-48e0-bdb8-b0a3295c1de7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.342137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:54.357921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886334-2cde-457a-be7e-8e2c9ddebd43 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.364160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1033/2091] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:54.364160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.364160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.364160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.365633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f93f30-7c83-42d3-94df-9dee51ad2b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.366587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93f30-7c83-42d3-94df-9dee51ad2b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.366925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93f30-7c83-42d3-94df-9dee51ad2b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.367243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93f30-7c83-42d3-94df-9dee51ad2b34 admin admin] PATH_INFO: `/v3/projects/18817b5c24fe4e2b8be34cc7b4f6ff2f/users/d2927634920a49e4a4d6c6d0e41c6a4a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.383424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:54.384418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f93f30-7c83-42d3-94df-9dee51ad2b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18817b5c24fe4e2b8be34cc7b4f6ff2f, user_id=d2927634920a49e4a4d6c6d0e41c6a4a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.384714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:54.386346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f93f30-7c83-42d3-94df-9dee51ad2b34 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.392646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1034/2092] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:54.393450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.394693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:54.406861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538f7a-a198-44c2-a298-972c2f6b87c0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.411495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.412402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.412684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.413052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] PATH_INFO: `/v3/projects/da2d689b947046acb73a5c6e5ecf4fde/users/df9e3ee032e4400890b7b69be46badd6/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.427448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2d689b947046acb73a5c6e5ecf4fde, user_id=df9e3ee032e4400890b7b69be46badd6, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.430464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.466023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1059/2093] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:54 2022] PUT /identity/v3/projects/18817b5c24fe4e2b8be34cc7b4f6ff2f/users/d2927634920a49e4a4d6c6d0e41c6a4a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:54.467507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455625d-cb12-449c-9eb6-31532050887e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.467937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455625d-cb12-449c-9eb6-31532050887e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.468357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455625d-cb12-449c-9eb6-31532050887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.486145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1455625d-cb12-449c-9eb6-31532050887e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:54.487365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1455625d-cb12-449c-9eb6-31532050887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:54.544876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1060/2094] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:54.546217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fadac-1d2d-49bf-9dc0-9aec4afdc870 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.546434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fadac-1d2d-49bf-9dc0-9aec4afdc870 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.546714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fadac-1d2d-49bf-9dc0-9aec4afdc870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.553814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1035/2095] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:54 2022] PUT /identity/v3/projects/da2d689b947046acb73a5c6e5ecf4fde/users/df9e3ee032e4400890b7b69be46badd6/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:54.554943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.573992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d78fadac-1d2d-49bf-9dc0-9aec4afdc870 None None] MFA Rules not processed for user `d2927634920a49e4a4d6c6d0e41c6a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:54.575191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d78fadac-1d2d-49bf-9dc0-9aec4afdc870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:54.625546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78648e-6eca-4336-843d-39875e8b79ce admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.630823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.631488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.631766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.632114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.632836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:54.633142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.634761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.639283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1061/2096] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:54.640595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.640886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.641160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.646918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1036/2097] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:47:54.650198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.662002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd9430-6130-405f-803c-8d3b60bb4c08 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.666995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.667608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] MFA Rules not processed for user `df9e3ee032e4400890b7b69be46badd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:54.667748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.667929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.668238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.668854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:54.668949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.674901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.723400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:54.740911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1062/2098] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:54.741729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.751643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf27e0-7d6b-426f-9cd3-e5a4fc21ee49 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.757051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.757687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.757967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.758240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.758921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.760849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.818000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1037/2099] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/projects => generated 355 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:54.818870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.857515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1063/2100] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:54.858330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:54.887496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaea94-ed68-4572-9ae4-563c68f8bd4a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.908366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:54.926607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af4c7-2976-413d-aa23-b08f69926571 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:54.931623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.932321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.932607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.932877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.933591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.935604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:54.947995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:54.948741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:54.949010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:54.949302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:54.949995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:54.951868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.047637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1064/2101] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:55.047637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.056654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326b639-739a-4fd5-b639-c07f1bfb67c2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.061410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.062042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.062327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.062604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.063279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.065238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.074694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1038/2102] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:54 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:55.075705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.138242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be435-2a08-44b3-b26a-1c7610072389 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.142968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.143635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.143922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.144234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.145155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.146924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.156887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1039/2103] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:55.157745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.170515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5800c-1b52-4d9e-8eb6-1cb9c7cb5a1a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.176672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.177350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.177631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.177908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.178604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.180615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.186191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1065/2104] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:55 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:55.186191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.194683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d56de-4663-42d4-a56a-ab0eb48bdfd2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.199284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.200220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.200536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.200805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] PATH_INFO: `/v3/projects/92d76c15c26e4f588f541a77a967e7db/users/c4573271ffa04ee48b0cc8936a5012b8/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.215910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d76c15c26e4f588f541a77a967e7db, user_id=c4573271ffa04ee48b0cc8936a5012b8, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.218680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.244714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:55.277023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1040/2105] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:55 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:55.277913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.287857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853aa8d-c078-43c0-905c-cd6b4c5f5de9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.297441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.297441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.297441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:55.297441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.297785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.297785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.298761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.303117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1066/2106] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:55 2022] PUT /identity/v3/projects/92d76c15c26e4f588f541a77a967e7db/users/c4573271ffa04ee48b0cc8936a5012b8/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:55.303117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.313767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1041/2107] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:55.315055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.325739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d55d-a4b1-4b0f-af76-1d133140372f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.369601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a794108-27d8-4b41-a0d2-42fc824461a3 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.376635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.377347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.377634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.377915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.378652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.381278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.390020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.390710 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.391063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.391409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.395771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1067/2108] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:55.395918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.396036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.396735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.398865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:55.407157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1042/2109] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:55.408260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.416315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab945b4-b2f3-4000-bff0-0234f12891ee admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.418305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c7eca-fdd2-47cf-b93a-4664e0197b90 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.421523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.422572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.422858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.423053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.423164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] PATH_INFO: `/v3/users/f0da90c1092b43df9163b6bb9d6743cd` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.423678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.423961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.424267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.424730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0da90c1092b43df9163b6bb9d6743cd)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.424989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.427406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.427538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.437205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:55.443877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1043/2110] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:55.443877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.451717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c2a7-b237-4e21-80f9-9f94adf296be admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.456766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.457601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.458234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.458487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.459265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.461083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.465103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:55.480806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1044/2111] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:55.481733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.492799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e09695-5d00-4f1b-b338-8313ab8db11a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.501147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.501147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.501147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.501147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] PATH_INFO: `/v3/projects/92d76c15c26e4f588f541a77a967e7db/users/c4573271ffa04ee48b0cc8936a5012b8/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.501505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d76c15c26e4f588f541a77a967e7db, user_id=c4573271ffa04ee48b0cc8936a5012b8, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.503730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.514508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1045/2112] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:55 2022] PUT /identity/v3/projects/92d76c15c26e4f588f541a77a967e7db/users/c4573271ffa04ee48b0cc8936a5012b8/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:55.520845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.589693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad24fca-771b-4c34-8035-f7dad27b9137 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.594368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.595252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.595535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.595810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] PATH_INFO: `/v3/projects/e5c04189ae69493ab2052a073e655dbd/users/753c74fac7444134af47b84f805bf25b/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.610844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c04189ae69493ab2052a073e655dbd, user_id=753c74fac7444134af47b84f805bf25b, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.621612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.651137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0da90c1092b43df9163b6bb9d6743cd'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:55.651733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0da90c1092b43df9163b6bb9d6743cd'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:55.702142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1046/2113] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:55 2022] PUT /identity/v3/projects/e5c04189ae69493ab2052a073e655dbd/users/753c74fac7444134af47b84f805bf25b/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:55.702955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.718836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0da90c1092b43df9163b6bb9d6743cd'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:55.719471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0da90c1092b43df9163b6bb9d6743cd'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:55.728461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b60c0ef7-4843-43ee-956e-c12a92ed96a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0da90c1092b43df9163b6bb9d6743cd'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:55.746833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1068/2114] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:47:55 2022] DELETE /identity/v3/users/f0da90c1092b43df9163b6bb9d6743cd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:55.751080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67307-e557-4375-b684-753f37ed1091 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.751369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67307-e557-4375-b684-753f37ed1091 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.751995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67307-e557-4375-b684-753f37ed1091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.779888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d41cb-67b4-4901-b59c-83380d9f688c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:55.782323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-8ad67307-e557-4375-b684-753f37ed1091 None None] MFA Rules not processed for user `c4573271ffa04ee48b0cc8936a5012b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:55.783557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8ad67307-e557-4375-b684-753f37ed1091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:55.804159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:55.841369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe56e3e-0a65-4735-a73c-149c0f376454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:55.842268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe56e3e-0a65-4735-a73c-149c0f376454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.842556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe56e3e-0a65-4735-a73c-149c0f376454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.842833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe56e3e-0a65-4735-a73c-149c0f376454 admin admin] PATH_INFO: `/v3/projects/79ad865574f046f18643125b5c649533/users/6e9318a00f2548e0be099b6192b7a44f/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.855821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1069/2115] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:55.856334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:55.857400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.857714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.858379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.860700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe56e3e-0a65-4735-a73c-149c0f376454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ad865574f046f18643125b5c649533, user_id=6e9318a00f2548e0be099b6192b7a44f, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:55.866793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe56e3e-0a65-4735-a73c-149c0f376454 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:55.888103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] MFA Rules not processed for user `753c74fac7444134af47b84f805bf25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:55.889416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:55.953455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1047/2116] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:55 2022] PUT /identity/v3/projects/79ad865574f046f18643125b5c649533/users/6e9318a00f2548e0be099b6192b7a44f/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:55.954880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1070/2117] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:55.955569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:55.960370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26669c-aec6-4c8b-81e5-9c7d4b6513a2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:55.960794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26669c-aec6-4c8b-81e5-9c7d4b6513a2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:55.961156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26669c-aec6-4c8b-81e5-9c7d4b6513a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:55.963904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:55.980677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5d26669c-aec6-4c8b-81e5-9c7d4b6513a2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:55.982544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5d26669c-aec6-4c8b-81e5-9c7d4b6513a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.022609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb2d5-8726-4418-b3ff-7dc709d826da None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.043338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1048/2118] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:56.044658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.044949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.045229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.054194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:56.074013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.074707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.075140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.075283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] MFA Rules not processed for user `6e9318a00f2548e0be099b6192b7a44f`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:56.075435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.076606 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.077842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:56.142400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1049/2119] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:56.143250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.145162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.147669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.149164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.156363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f121-9548-4c59-a9c1-0f53810db5b8 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.159088 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1071/2120] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:55 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:56.159889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.160019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.160653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.160939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.161387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.161992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.169994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:56.185827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:56.225315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.226735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.229506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848534-10fd-4320-8f2a-d472c0fc250a service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.234574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.235229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.235512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.236081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.236201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1050/2121] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:56.236835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.238010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.251436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.253290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.257681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744ad2-c60d-4985-a5dc-b7d5366f983f service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.263393 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.264246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.264517 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.264845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.265570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.266052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1072/2122] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:56.268294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.398803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.408306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad65-e5cd-40c5-95b1-33460b2b094b service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.416034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.416190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1051/2123] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:56 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:56.416622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.416622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.416622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.417391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.417649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.479610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.481990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.493170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1073/2124] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:56.493372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dbace-b8f5-4a19-8f11-d77314ebb7f4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.498565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.499287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.499576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.499846 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.500944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.502591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.637916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1052/2125] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:56 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:56.642257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.656440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2844c2-2480-4c6d-872d-b5cf7cf56e2b service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.657127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:56.661740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.662357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.662635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.662905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.664373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.665261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.677072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1074/2126] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:56.683099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.696149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b12a8-a0a4-40d9-b44f-68d574075555 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.700987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.701910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.702215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.702492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] PATH_INFO: `/v3/projects/8dcdc859d94f47d1b0ae63811ace56d7/users/a715f6d53a2c4c7099f969912405740c/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.719661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcdc859d94f47d1b0ae63811ace56d7, user_id=a715f6d53a2c4c7099f969912405740c, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.723404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.741438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:56.801738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.803796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:56.817227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78f65-246b-46ca-8e59-9f00ea23ce00 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.822481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.823541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.823826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.824459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] PATH_INFO: `/v3/projects/8f23b2321e8d43699d3ca9c1addd715b` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.825901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f23b2321e8d43699d3ca9c1addd715b)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.831501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.831593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1053/2127] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:56 2022] PUT /identity/v3/projects/8dcdc859d94f47d1b0ae63811ace56d7/users/a715f6d53a2c4c7099f969912405740c/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:56.834812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.904794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43e2d-9d43-418d-a818-7a0eca75ab17 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.909900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:56.911236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:56.911762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:56.912161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:56.912972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:56.915027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:56.924903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1054/2128] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:47:56.929326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:56.951333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b10cd-8db2-4e31-9c68-3e209f0e4956 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:56.973552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f23b2321e8d43699d3ca9c1addd715b', 'request_id': 'req-013964eb-e639-4894-ae4b-ef6ab7543c77'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:57.061402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb7d8-32db-403d-9f72-64be7c777f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.062631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb7d8-32db-403d-9f72-64be7c777f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.062755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f23b2321e8d43699d3ca9c1addd715b', 'request_id': 'req-013964eb-e639-4894-ae4b-ef6ab7543c77'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:57.062864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb7d8-32db-403d-9f72-64be7c777f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.063073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb7d8-32db-403d-9f72-64be7c777f2b admin admin] PATH_INFO: `/v3/projects/8dcdc859d94f47d1b0ae63811ace56d7/users/a715f6d53a2c4c7099f969912405740c/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.065879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfb7d8-32db-403d-9f72-64be7c777f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcdc859d94f47d1b0ae63811ace56d7, user_id=a715f6d53a2c4c7099f969912405740c, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.070210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfb7d8-32db-403d-9f72-64be7c777f2b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.070334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f23b2321e8d43699d3ca9c1addd715b', 'request_id': 'req-013964eb-e639-4894-ae4b-ef6ab7543c77'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:57.101687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1055/2129] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:56 2022] PUT /identity/v3/projects/8dcdc859d94f47d1b0ae63811ace56d7/users/a715f6d53a2c4c7099f969912405740c/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:57.103918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.104250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.105435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.109581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] The token cache is being invalidate because project 8f23b2321e8d43699d3ca9c1addd715b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:47:57.109883 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:57.110561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-013964eb-e639-4894-ae4b-ef6ab7543c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:47:57.112325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1075/2130] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:47:56 2022] DELETE /identity/v3/projects/8f23b2321e8d43699d3ca9c1addd715b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:47:57.117906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161cd93-0696-436d-9b2b-e42f5efac060 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.118215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161cd93-0696-436d-9b2b-e42f5efac060 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.118502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161cd93-0696-436d-9b2b-e42f5efac060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.134336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] MFA Rules not processed for user `a715f6d53a2c4c7099f969912405740c`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:57.135536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.137688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3161cd93-0696-436d-9b2b-e42f5efac060 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:57.138851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3161cd93-0696-436d-9b2b-e42f5efac060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.199144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1076/2131] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:57.207082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.207380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.207802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.210246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1056/2132] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:57.221630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.223753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.228026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:57.229243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.237543 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1077/2133] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:47:57.241897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.251682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac62ae-44bc-48ef-a007-071899e94974 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.256764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:57.257384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.258042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.258375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.258644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.259356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:47:57.259655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.261305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.276661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1078/2134] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:47:57.277626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.284438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4629d6-fec8-4a90-9d1e-15906893a39e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.287520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101d2c4-cf7a-4dab-a2fc-df9ba9ed31af admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.289137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.290035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.290299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.290581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.292419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.292634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.293072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.293355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.293664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.294422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.296430 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.352440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.353870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.363192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1057/2135] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:57.388182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:57.389812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1079/2136] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:47:57 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:47:57.390669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.401612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ab87-0130-40a9-81b5-bab23f5d8f82 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.458729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.459420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.459709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.459992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.460719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.462689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.588765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1058/2137] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:47:57 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:47:57.590170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.601472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be44b2-a0c9-4319-9da1-eb9ff9029409 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.606009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.606683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.606963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.607233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.607974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.609598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.619776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1080/2138] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:57.623835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.634024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b5616-0589-4163-b8ff-2a0ac7ffe3e7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.638673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d1bc-6c0e-4b2e-a6dc-b186701a63fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.639328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d1bc-6c0e-4b2e-a6dc-b186701a63fa admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.639639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d1bc-6c0e-4b2e-a6dc-b186701a63fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.639912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d1bc-6c0e-4b2e-a6dc-b186701a63fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.640675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d1bc-6c0e-4b2e-a6dc-b186701a63fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.642255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d1bc-6c0e-4b2e-a6dc-b186701a63fa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.652756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1059/2139] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:47:57.657060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.667560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dafeb-44b0-4165-8a7b-8fc8e11c095b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.672208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.673082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.673358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.673641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] PATH_INFO: `/v3/projects/1b38f30ffdc74b66aa2a5ed7d7eb1e0d/users/28d78d4ead234cc68e377c8b5b6e4d5a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.689466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b38f30ffdc74b66aa2a5ed7d7eb1e0d, user_id=28d78d4ead234cc68e377c8b5b6e4d5a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.692462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.799084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1081/2140] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:47:57 2022] PUT /identity/v3/projects/1b38f30ffdc74b66aa2a5ed7d7eb1e0d/users/28d78d4ead234cc68e377c8b5b6e4d5a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:47:57.804866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857815-5fc0-418e-af24-a17df10ca305 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.805224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857815-5fc0-418e-af24-a17df10ca305 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.805512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857815-5fc0-418e-af24-a17df10ca305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.824848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-a4857815-5fc0-418e-af24-a17df10ca305 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:57.826137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a4857815-5fc0-418e-af24-a17df10ca305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.879514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:57.896033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1060/2141] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:57.906626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:57.908786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:57.966324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4d20-eb67-4f97-98d9-55f669fdcc28 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:57.970221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:57.970879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:57.971163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:57.971752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:57.982934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:57.984452 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:57.994271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1082/2142] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:47:58.299907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:58.708238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:59.268021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:59.357501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:59.357884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:59.358167 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:59.388900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] MFA Rules not processed for user `28d78d4ead234cc68e377c8b5b6e4d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:47:59.390123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:59.459237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1061/2143] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:47:59.470600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:47:59.472382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:47:59.530022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ac48-1d1c-4091-9e02-4e666a021731 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:47:59.533536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:47:59.534192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:47:59.534477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:47:59.534756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:47:59.544903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:47:59.546418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:47:59.557900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1083/2144] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:47:59.673314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:00.474419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:00.496811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:00.511444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504fb87-8c8b-424a-8d1a-f71c6c7a520e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:00.517705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:00.518557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:00.518852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:00.519137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:00.521441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:00.608448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:00.609809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bcdd-dae7-48e1-9966-25ab914c8045 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:00.619405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1062/2145] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:00.912660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:01.079477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:01.336270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:01.573712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:01.607926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:01.758973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:01.830466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:02.107721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:02.227589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:02.255958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:02.399158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:INSERT=8,keystone:DELETE=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:02.467428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:02.885362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:03.034025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:03.043175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84cf5-eefd-4c62-b02a-db536c7abe4c service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:03.046788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:03.047422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:03.047704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:03.047980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:03.089719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:03.110149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:03.111743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:03.122368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1084/2146] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:03.490295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:03.539093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:03.609651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655ed1-254f-4f51-87d1-0e58a770a6f7 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:03.609943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655ed1-254f-4f51-87d1-0e58a770a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:03.610226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655ed1-254f-4f51-87d1-0e58a770a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:03.628372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c4655ed1-254f-4f51-87d1-0e58a770a6f7 None None] MFA Rules not processed for user `28d78d4ead234cc68e377c8b5b6e4d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:03.630323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c4655ed1-254f-4f51-87d1-0e58a770a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:03.637342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1063/2147] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:03.751025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:10.008529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:10.010015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:10.027359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6338c-02e6-43ff-9977-1e3e9be55823 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:10.034681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:10.035964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:10.036282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:10.036767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] PATH_INFO: `/v3/users/df9e3ee032e4400890b7b69be46badd6` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:10.037992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9e3ee032e4400890b7b69be46badd6)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:10.039935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:10.241738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9e3ee032e4400890b7b69be46badd6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:10.242352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9e3ee032e4400890b7b69be46badd6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:10.313051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9e3ee032e4400890b7b69be46badd6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:10.313854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9e3ee032e4400890b7b69be46badd6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:10.323765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9e3ee032e4400890b7b69be46badd6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:10.344147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1085/2148] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:10 2022] DELETE /identity/v3/users/df9e3ee032e4400890b7b69be46badd6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:10.349584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:10.350105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:10.350206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:10.369604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:10.373162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:10.434879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1064/2149] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:10.447349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:10.448861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:10.508966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513bfb2-5056-4384-8ef5-34bbffb82b4e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:10.512509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:10.513163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:10.513443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:10.513713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:10.523716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:10.525210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:10.535866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1086/2150] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:11.040267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:11.041861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:11.092099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abdd2-ae50-4e01-9866-178f350693f0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:11.104876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:11.105871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:11.106158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:11.106437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] PATH_INFO: `/v3/projects/da2d689b947046acb73a5c6e5ecf4fde` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:11.114527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2d689b947046acb73a5c6e5ecf4fde)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:11.116613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:11.326766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2d689b947046acb73a5c6e5ecf4fde', 'request_id': 'req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.333155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2d689b947046acb73a5c6e5ecf4fde', 'request_id': 'req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.339030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:11.444818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2d689b947046acb73a5c6e5ecf4fde', 'request_id': 'req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.463495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] The token cache is being invalidate because project da2d689b947046acb73a5c6e5ecf4fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:11.463791 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.464462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.466076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1065/2151] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:11 2022] DELETE /identity/v3/projects/da2d689b947046acb73a5c6e5ecf4fde => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:11.470035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:11.480417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c34aa-5db2-4c47-9d9d-5bcb193a0ea6 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:11.539741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:11.540637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:11.540924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:11.541202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] PATH_INFO: `/v3/users/6e9318a00f2548e0be099b6192b7a44f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:11.543019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9318a00f2548e0be099b6192b7a44f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:11.545671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:11.553194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:11.846954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9318a00f2548e0be099b6192b7a44f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.847613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9318a00f2548e0be099b6192b7a44f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.996689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9318a00f2548e0be099b6192b7a44f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:11.998676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9318a00f2548e0be099b6192b7a44f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:12.007434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9318a00f2548e0be099b6192b7a44f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:12.029807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1087/2152] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:11 2022] DELETE /identity/v3/users/6e9318a00f2548e0be099b6192b7a44f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:12.755027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:12.757032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:12.773556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e613d-6e23-4f60-aaf0-73ecab2eb8ac admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:12.833482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:12.834382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:12.834687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:12.834946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] PATH_INFO: `/v3/projects/79ad865574f046f18643125b5c649533` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:12.836173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ad865574f046f18643125b5c649533)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:12.838228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:12.964020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ad865574f046f18643125b5c649533', 'request_id': 'req-1fa0c59b-ef13-4d66-8690-870a4569e156'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:12.970151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ad865574f046f18643125b5c649533', 'request_id': 'req-1fa0c59b-ef13-4d66-8690-870a4569e156'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.093543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ad865574f046f18643125b5c649533', 'request_id': 'req-1fa0c59b-ef13-4d66-8690-870a4569e156'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.109685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] The token cache is being invalidate because project 79ad865574f046f18643125b5c649533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:13.109983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.110658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.112396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1066/2153] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:12 2022] DELETE /identity/v3/projects/79ad865574f046f18643125b5c649533 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:13.116563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:13.118213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:13.131161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24e326-8a35-4ddb-a37d-67a7ad452707 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:13.192027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:13.193117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:13.193370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:13.193640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] PATH_INFO: `/v3/users/a715f6d53a2c4c7099f969912405740c` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:13.194958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a715f6d53a2c4c7099f969912405740c)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:13.196935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:13.387607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a715f6d53a2c4c7099f969912405740c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.388340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a715f6d53a2c4c7099f969912405740c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.447744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a715f6d53a2c4c7099f969912405740c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.448480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a715f6d53a2c4c7099f969912405740c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.456097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-7a75f02e-a0a7-4e32-a536-09a0d2ba35a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a715f6d53a2c4c7099f969912405740c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:13.474076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1088/2154] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:13 2022] DELETE /identity/v3/users/a715f6d53a2c4c7099f969912405740c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:14.094314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.096643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:14.111049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c59b-ef13-4d66-8690-870a4569e156 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.170945 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.171947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.172392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.172982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] PATH_INFO: `/v3/projects/8dcdc859d94f47d1b0ae63811ace56d7` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.174031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcdc859d94f47d1b0ae63811ace56d7)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.176668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.199653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:14.293434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcdc859d94f47d1b0ae63811ace56d7', 'request_id': 'req-193bb8c2-24b9-4095-894d-1918c192fc55'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:14.301642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcdc859d94f47d1b0ae63811ace56d7', 'request_id': 'req-193bb8c2-24b9-4095-894d-1918c192fc55'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:14.369703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcdc859d94f47d1b0ae63811ace56d7', 'request_id': 'req-193bb8c2-24b9-4095-894d-1918c192fc55'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:14.381063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] The token cache is being invalidate because project 8dcdc859d94f47d1b0ae63811ace56d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:14.381361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:14.382085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-193bb8c2-24b9-4095-894d-1918c192fc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:14.384459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1067/2155] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:14 2022] DELETE /identity/v3/projects/8dcdc859d94f47d1b0ae63811ace56d7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:14.389266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.389731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.389848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.397805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:14.410357 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:14.411476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:14.469233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1089/2156] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:14.477627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.477920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.478202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.497354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:14.498559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:14.507248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1068/2157] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:14.511342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.521714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a7a09-d9b5-470f-ab35-8053ffdf3478 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.526494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.527149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.527433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.527708 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.528471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:48:14.528821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.530522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.543319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1090/2158] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:48:14.549926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.557127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d1bf8-b5d7-488f-b9b0-57676be0fc09 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.561777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.562421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.562706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.562983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.563685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.565695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.642466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1069/2159] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:14 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:14.647093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.657227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cbee-0f4e-4883-a1ba-286f8584b2f5 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.712722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.713388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.713669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.713968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.714648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.716620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.790516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1091/2160] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:14 2022] POST /identity/v3/users => generated 282 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:14.791987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.802762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462706dc-a896-441c-9461-9ea2fbcb8c4e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.807843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.808544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.808856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.809236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.809850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.811463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.825792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1070/2161] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:14.829150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.840164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b5d0b-0b15-45dd-a670-4225e48f92aa admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.845073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0f22-4c77-42ff-b701-0d2b28c7e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.848664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0f22-4c77-42ff-b701-0d2b28c7e79f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.848664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0f22-4c77-42ff-b701-0d2b28c7e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.848664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0f22-4c77-42ff-b701-0d2b28c7e79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.848664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0f22-4c77-42ff-b701-0d2b28c7e79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.849580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0f22-4c77-42ff-b701-0d2b28c7e79f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.859555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1092/2162] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:14.863685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:14.873669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d71dd-b5d6-4c49-9187-c0c9dad5c9e5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:14.879182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:14.880077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.880381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.880662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] PATH_INFO: `/v3/projects/abb3513324ac4a029b00b1ffda447616/users/b21385f40f4045078185753081f4b689/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:14.896357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb3513324ac4a029b00b1ffda447616, user_id=b21385f40f4045078185753081f4b689, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:14.899104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:14.958885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1071/2163] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:14 2022] PUT /identity/v3/projects/abb3513324ac4a029b00b1ffda447616/users/b21385f40f4045078185753081f4b689/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:14.965757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:14.966223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:14.966511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:15.021827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] MFA Rules not processed for user `b21385f40f4045078185753081f4b689`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:15.023012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:15.114819 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:15.123309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1093/2164] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:15.134646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:15.136520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:15.201536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104cf1-8e2c-42d4-865f-dc8ddff6a11e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:15.205750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482955-344e-4d5d-8bef-4f8ba2051791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:15.207204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482955-344e-4d5d-8bef-4f8ba2051791 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:15.207459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482955-344e-4d5d-8bef-4f8ba2051791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:15.207736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482955-344e-4d5d-8bef-4f8ba2051791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:15.217456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482955-344e-4d5d-8bef-4f8ba2051791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:15.218839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482955-344e-4d5d-8bef-4f8ba2051791 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:15.229298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1072/2165] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:24.968005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:24.969944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:25.052769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9f69-4bdd-43f8-927f-eb5f3057ada5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:25.058535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:25.059878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:25.060229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:25.060513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] PATH_INFO: `/v3/users/753c74fac7444134af47b84f805bf25b` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:25.062188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=753c74fac7444134af47b84f805bf25b)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:25.064642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:25.224739 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:25.319772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753c74fac7444134af47b84f805bf25b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:25.320670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753c74fac7444134af47b84f805bf25b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:25.387437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753c74fac7444134af47b84f805bf25b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:25.388137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753c74fac7444134af47b84f805bf25b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:25.396371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753c74fac7444134af47b84f805bf25b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:25.415677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1094/2166] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:24 2022] DELETE /identity/v3/users/753c74fac7444134af47b84f805bf25b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:25.420598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:25.421029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:25.421377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:25.439549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:25.440829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:25.531303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1073/2167] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:25.542935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:25.544931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:25.611964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac19e6-e396-4d20-a255-287ae4a8e48c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:25.616291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2af4-a3f4-463c-8b0d-3e5f251faed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:25.617189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2af4-a3f4-463c-8b0d-3e5f251faed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:25.617476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2af4-a3f4-463c-8b0d-3e5f251faed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:25.617753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2af4-a3f4-463c-8b0d-3e5f251faed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:25.627433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2af4-a3f4-463c-8b0d-3e5f251faed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:25.631775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2af4-a3f4-463c-8b0d-3e5f251faed1 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:25.640129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1095/2168] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:26.062304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.063744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:26.075955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8b6d-eaad-4d44-a977-ea258cf5b482 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.080618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.081997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.082317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.082777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] PATH_INFO: `/v3/projects/e5c04189ae69493ab2052a073e655dbd` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.084293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c04189ae69493ab2052a073e655dbd)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.086573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.205454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c04189ae69493ab2052a073e655dbd', 'request_id': 'req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:26.212535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c04189ae69493ab2052a073e655dbd', 'request_id': 'req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:26.333102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c04189ae69493ab2052a073e655dbd', 'request_id': 'req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:26.344749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] The token cache is being invalidate because project e5c04189ae69493ab2052a073e655dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:26.345034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:26.345684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5c22a81-65fa-460a-b88f-2d2b5e0a13db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:26.347769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1074/2169] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:26 2022] DELETE /identity/v3/projects/e5c04189ae69493ab2052a073e655dbd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:26.353001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.353457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.353546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.374762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:26.374762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:26.389903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:26.434252 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1096/2170] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:26.443358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.443649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.443931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.462854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:26.464019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:26.472420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1075/2171] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:26.482669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.493246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8cce1-e51a-4bcf-af59-35e6e5a0f293 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.498103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.498850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.499136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.499406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.500236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:48:26.500547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.502155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.517682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1097/2172] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:48:26.522615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.532421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00c54-f12b-4c6d-a755-03b076aeee2f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.537520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.538396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.538702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.538981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.539679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.541617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.680732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1076/2173] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:26 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:26.685035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.691944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.695137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:26.697931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68974f-e1a7-4db6-a05b-a22fdafdf486 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.763782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:26.769373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.769373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.769629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b2db-9b53-457a-a251-c9c7ed4d5358 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.769892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.769892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.770535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.772859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.774445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.775397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.775751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.776130 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] PATH_INFO: `/v3/users/d2927634920a49e4a4d6c6d0e41c6a4a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.777436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2927634920a49e4a4d6c6d0e41c6a4a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.779492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.865757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1098/2174] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:26 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:26.866859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.876844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775f3a-ac38-4f9b-b993-0f9555f80530 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.882048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.882665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.882950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.883228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.884017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.885747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.896125 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1099/2175] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:26.900115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.909880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ac41c-7147-407e-b71f-9826ca75fe9a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.915538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.921059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.921059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.921059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.921059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.921059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:26.928242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2927634920a49e4a4d6c6d0e41c6a4a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:26.937255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1100/2176] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:26.942225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:26.953047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19861d9-40c1-425b-a6cb-955b18123ef4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:26.958191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba635ec-4ab4-4f99-8549-72527e0eb6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:26.959098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba635ec-4ab4-4f99-8549-72527e0eb6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:26.959364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba635ec-4ab4-4f99-8549-72527e0eb6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:26.959646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba635ec-4ab4-4f99-8549-72527e0eb6c9 admin admin] PATH_INFO: `/v3/projects/e1255f046ce547b29ed745e1d3236453/users/88309c17cd4f4451a1388b518cfc2120/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:26.976552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba635ec-4ab4-4f99-8549-72527e0eb6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1255f046ce547b29ed745e1d3236453, user_id=88309c17cd4f4451a1388b518cfc2120, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:26.980459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba635ec-4ab4-4f99-8549-72527e0eb6c9 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:27.035830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2927634920a49e4a4d6c6d0e41c6a4a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:27.036646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2927634920a49e4a4d6c6d0e41c6a4a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:27.037512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2927634920a49e4a4d6c6d0e41c6a4a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:27.044987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-fc6825bc-ec8a-4777-bde3-fd3567ded516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2927634920a49e4a4d6c6d0e41c6a4a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:27.063344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1077/2177] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:26 2022] DELETE /identity/v3/users/d2927634920a49e4a4d6c6d0e41c6a4a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:27.068031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:27.068342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:27.068617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:27.086769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:27.088090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:27.093072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1101/2178] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:26 2022] PUT /identity/v3/projects/e1255f046ce547b29ed745e1d3236453/users/88309c17cd4f4451a1388b518cfc2120/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:27.109153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:27.109453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:27.109732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:27.148552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] MFA Rules not processed for user `88309c17cd4f4451a1388b518cfc2120`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:27.153742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:27.161566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1078/2179] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:27.172672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:27.174422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:27.204270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:27.233810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1102/2180] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:27.245720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78547f-dac5-404c-b881-4294d28ee15c None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:27.256229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:27.257915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:27.258726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:27.259482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:27.259818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:27.260148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:27.270653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:27.272112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:27.281934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1079/2181] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:48:27.333942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc35f1-1f56-47af-8c87-9a9f9f53766b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:27.338395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:27.338939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:27.339228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:27.339507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:27.351710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:27.356236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:27.380821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1103/2182] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:48:27.825822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:27.828222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:27.847898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40019-7f3d-40a0-9863-50854917bc52 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:27.856418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:27.856418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:27.856418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:27.856418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] PATH_INFO: `/v3/projects/18817b5c24fe4e2b8be34cc7b4f6ff2f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:27.857005 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=18817b5c24fe4e2b8be34cc7b4f6ff2f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:27.857602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:27.870892 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:27.985250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18817b5c24fe4e2b8be34cc7b4f6ff2f', 'request_id': 'req-cdee87e3-faab-46ef-a3a1-6686a4191eab'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:27.991469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18817b5c24fe4e2b8be34cc7b4f6ff2f', 'request_id': 'req-cdee87e3-faab-46ef-a3a1-6686a4191eab'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.121297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18817b5c24fe4e2b8be34cc7b4f6ff2f', 'request_id': 'req-cdee87e3-faab-46ef-a3a1-6686a4191eab'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.133397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] The token cache is being invalidate because project 18817b5c24fe4e2b8be34cc7b4f6ff2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:28.133686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.134336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.135880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1080/2183] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:27 2022] DELETE /identity/v3/projects/18817b5c24fe4e2b8be34cc7b4f6ff2f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:28.139794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:28.151760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322741c-fa9a-4542-8e87-aa3f7d529eb2 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:28.212697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:28.213645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:28.213903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:28.214206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] PATH_INFO: `/v3/users/c4573271ffa04ee48b0cc8936a5012b8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:28.215498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4573271ffa04ee48b0cc8936a5012b8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:28.217464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:28.428760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4573271ffa04ee48b0cc8936a5012b8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.429762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4573271ffa04ee48b0cc8936a5012b8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.509808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4573271ffa04ee48b0cc8936a5012b8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.510530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4573271ffa04ee48b0cc8936a5012b8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.518640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-bdc0534e-ce1b-4cc5-bc54-f27af7c31a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4573271ffa04ee48b0cc8936a5012b8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:28.538206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1104/2184] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:28 2022] DELETE /identity/v3/users/c4573271ffa04ee48b0cc8936a5012b8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:28.945594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:28.947114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:28.961056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee87e3-faab-46ef-a3a1-6686a4191eab admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.020341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.021128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.021413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.021721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] PATH_INFO: `/v3/projects/92d76c15c26e4f588f541a77a967e7db` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.022907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d76c15c26e4f588f541a77a967e7db)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.024985 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.125113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d76c15c26e4f588f541a77a967e7db', 'request_id': 'req-18967913-3e78-433a-b29e-aaf60aeaab13'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:29.131413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d76c15c26e4f588f541a77a967e7db', 'request_id': 'req-18967913-3e78-433a-b29e-aaf60aeaab13'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:29.203250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d76c15c26e4f588f541a77a967e7db', 'request_id': 'req-18967913-3e78-433a-b29e-aaf60aeaab13'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:29.214146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] The token cache is being invalidate because project 92d76c15c26e4f588f541a77a967e7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:29.214437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:29.215064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-18967913-3e78-433a-b29e-aaf60aeaab13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:29.216893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1081/2185] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:28 2022] DELETE /identity/v3/projects/92d76c15c26e4f588f541a77a967e7db => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:29.223155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.225256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.225256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.231156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:29.243216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:29.244469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:29.304200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1105/2186] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:29.311716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.312007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.312315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.330641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:29.331872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:29.339942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1082/2187] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:29.344001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:29.354412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29dfd-7f7d-470b-8e32-166199d53d1e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.358975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.359632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.359910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.360222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.360939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:48:29.361246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.362888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.375140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1106/2188] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:48:29.379603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:29.388884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a688c-4798-4dea-86b4-64a842b64760 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.393465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.394106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.394526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.394982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.395632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.397556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.502283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1083/2189] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:29 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:29.506510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:29.517407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733d0-75d1-4497-bdfc-a887e29e335a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.575896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.576621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.576904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.577177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.577868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.579855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.667184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1107/2190] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:29 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:29.671294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:29.677058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:29.682520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21943e5-c1f1-4b1e-8ce5-f02e1d01a0b4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.687113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.687813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.688152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.688437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.689155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.690730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.701502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1084/2191] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:29.705476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:29.716922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae8ab-416f-4cce-b8a2-a4a793916eff admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.723564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1f906-8d2f-4e65-9e41-7aa20d23229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.724276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1f906-8d2f-4e65-9e41-7aa20d23229b admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.727647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1f906-8d2f-4e65-9e41-7aa20d23229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.727647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1f906-8d2f-4e65-9e41-7aa20d23229b admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.727647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1f906-8d2f-4e65-9e41-7aa20d23229b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.727647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1f906-8d2f-4e65-9e41-7aa20d23229b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.740830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1108/2192] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:29.742359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:29.753199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621e5b7-db36-4998-a37e-3a687c114d47 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:29.758610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:29.759496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.759782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.760079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] PATH_INFO: `/v3/projects/9f3d29bc2d4e41f38d20592a1c640294/users/38842cb6213b497caaa4c4768242e0f2/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.776108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3d29bc2d4e41f38d20592a1c640294, user_id=38842cb6213b497caaa4c4768242e0f2, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:29.778748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:29.862392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1085/2193] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:29 2022] PUT /identity/v3/projects/9f3d29bc2d4e41f38d20592a1c640294/users/38842cb6213b497caaa4c4768242e0f2/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:29.874115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:29.874746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:29.875366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:29.911905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] MFA Rules not processed for user `38842cb6213b497caaa4c4768242e0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:29.913161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:29.974538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:29.978233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1109/2194] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:29.987094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.048830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf417b-8eed-4df9-9f31-8b95835513ca admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.053817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.054466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.054748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.055021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.055743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.057683 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.137145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1086/2195] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:29 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:30.141141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.152966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e191-30f0-47b1-a23b-4791fd0f06f5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.210754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.211422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.211699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.211967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.212682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.214579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.301829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1110/2196] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:30 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:30.303081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.314446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3800db-5d4a-44cf-9927-4b5d5aacb7d2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.320235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.320911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.321200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.321476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.322204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.323891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.335064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1087/2197] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:30.339225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.349691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3b21-3b33-4a39-81e8-4a5ee3fbb90a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.354317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.355195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.355476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.355748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] PATH_INFO: `/v3/projects/5a1e0a5da9ac46d19fce8da0e0ce47a6/users/44d515fac3c24967982383d015e99780/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.370733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1e0a5da9ac46d19fce8da0e0ce47a6, user_id=44d515fac3c24967982383d015e99780, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.373478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.438368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1111/2198] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:30 2022] PUT /identity/v3/projects/5a1e0a5da9ac46d19fce8da0e0ce47a6/users/44d515fac3c24967982383d015e99780/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:30.443066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.453101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe839-396d-4cd4-9ffa-aabc6b6a13f9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.509401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1a534-282b-4990-9f69-16dbb351964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.510091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1a534-282b-4990-9f69-16dbb351964d admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.510377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1a534-282b-4990-9f69-16dbb351964d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.510659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1a534-282b-4990-9f69-16dbb351964d admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.511382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1a534-282b-4990-9f69-16dbb351964d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.513006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1a534-282b-4990-9f69-16dbb351964d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.522912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1088/2199] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:30.527008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.537275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022ae8-114c-4b8d-b3b0-fc8256cb1e7a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.541924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.542793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.543079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.543352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] PATH_INFO: `/v3/projects/5a1e0a5da9ac46d19fce8da0e0ce47a6/users/44d515fac3c24967982383d015e99780/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.545318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1e0a5da9ac46d19fce8da0e0ce47a6, user_id=44d515fac3c24967982383d015e99780, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.547949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.558449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1112/2200] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:30 2022] PUT /identity/v3/projects/5a1e0a5da9ac46d19fce8da0e0ce47a6/users/44d515fac3c24967982383d015e99780/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:30.570180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.570602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.570954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.599380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] MFA Rules not processed for user `44d515fac3c24967982383d015e99780`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:30.600762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:30.629817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:30.671844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1089/2201] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:30.683451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.685165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:30.741492 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba35c-4f27-45d8-a987-e190daccbd08 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.745113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.745751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.746040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.746316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.755435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.757028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:30.766671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1113/2202] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:30.901696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:30.903201 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:30.916403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bbe7a-1d66-4102-ba45-ccc1d5f84516 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:30.920267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fef62-afd8-4b66-8c7c-a5d7d1f20cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:30.920957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fef62-afd8-4b66-8c7c-a5d7d1f20cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:30.921249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fef62-afd8-4b66-8c7c-a5d7d1f20cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:30.923721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fef62-afd8-4b66-8c7c-a5d7d1f20cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:30.991075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fef62-afd8-4b66-8c7c-a5d7d1f20cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:30.992629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fef62-afd8-4b66-8c7c-a5d7d1f20cb2 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:31.001760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1090/2203] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:31.975223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:31.976700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:32.037879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:32.044432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef8324-7f9e-47b2-a915-33a90998575d service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:32.048939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:32.049817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:32.050098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:32.050455 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] PATH_INFO: `/v3/users/6bea631754c04668a92e99b6bb40337e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:32.051928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bea631754c04668a92e99b6bb40337e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:32.053892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:32.246630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bea631754c04668a92e99b6bb40337e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:32.247183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bea631754c04668a92e99b6bb40337e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:32.417323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bea631754c04668a92e99b6bb40337e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:32.418968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bea631754c04668a92e99b6bb40337e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:32.435163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bea631754c04668a92e99b6bb40337e'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:32.447389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1114/2204] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:31 2022] DELETE /identity/v3/users/6bea631754c04668a92e99b6bb40337e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:32.451894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:32.452410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:32.452490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:32.470870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:32.472424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:32.537036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1091/2205] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:32.544225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:32.545777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:32.613853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84272e7-7d2d-443b-a187-d7a566a60a3a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:32.624466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:32.625429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:32.625849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:32.626270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:32.639503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:32.641412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:32.653876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1115/2206] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:33.108258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:33.109753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:33.135265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444230f2-ae40-4653-a72a-e5793fa04f51 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:33.148316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:33.149402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:33.149758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:33.150105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] PATH_INFO: `/v3/projects/988cc5a3101e48e9b3820a3258789aab` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:33.151679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988cc5a3101e48e9b3820a3258789aab)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:33.154019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:33.296011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988cc5a3101e48e9b3820a3258789aab', 'request_id': 'req-ab77c23c-b080-488f-a16b-59fc5efe3940'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:33.302927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988cc5a3101e48e9b3820a3258789aab', 'request_id': 'req-ab77c23c-b080-488f-a16b-59fc5efe3940'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:33.306506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:33.401052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988cc5a3101e48e9b3820a3258789aab', 'request_id': 'req-ab77c23c-b080-488f-a16b-59fc5efe3940'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:33.415293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] The token cache is being invalidate because project 988cc5a3101e48e9b3820a3258789aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:33.415666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:33.416543 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ab77c23c-b080-488f-a16b-59fc5efe3940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:33.418171 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1092/2207] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:33 2022] DELETE /identity/v3/projects/988cc5a3101e48e9b3820a3258789aab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:35.049098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:35.050751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:35.077588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50fd51-fe7d-44dd-84ac-3608561987b7 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:35.141783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:35.142673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:35.142961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:35.143229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] PATH_INFO: `/v3/users/88309c17cd4f4451a1388b518cfc2120` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:35.145400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88309c17cd4f4451a1388b518cfc2120)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:35.147410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:35.151965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:35.326701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88309c17cd4f4451a1388b518cfc2120'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:35.327415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88309c17cd4f4451a1388b518cfc2120'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:35.413648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88309c17cd4f4451a1388b518cfc2120'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:35.415414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88309c17cd4f4451a1388b518cfc2120'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:35.426588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88309c17cd4f4451a1388b518cfc2120'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:35.445745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1116/2208] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:35 2022] DELETE /identity/v3/users/88309c17cd4f4451a1388b518cfc2120 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:35.450330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:35.450812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:35.450932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:35.481052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:35.482315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:35.568495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1093/2209] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:35.578003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:35.579522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:35.678669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a652d-42f1-4d4a-b908-10d8127c0e12 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:35.682494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:35.683176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:35.683519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:35.683799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:35.694685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:35.696641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:35.715615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1117/2210] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:36.245756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:36.247189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.260013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20474d4e-f3a9-4407-b42c-c2780dfa0aca None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:36.264837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:36.265707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.265996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.266269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] PATH_INFO: `/v3/projects/e1255f046ce547b29ed745e1d3236453` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.267531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1255f046ce547b29ed745e1d3236453)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:36.269827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:36.344188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:36.345724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.358885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2034670-52d5-46aa-8390-b7f535600c7a service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:36.364500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:36.370172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.370172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.370172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] PATH_INFO: `/v3/users/38842cb6213b497caaa4c4768242e0f2` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.370172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38842cb6213b497caaa4c4768242e0f2)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:36.370172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:36.408375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1255f046ce547b29ed745e1d3236453', 'request_id': 'req-917d365b-9ddc-4adc-acff-e6fe28922bef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.416454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1255f046ce547b29ed745e1d3236453', 'request_id': 'req-917d365b-9ddc-4adc-acff-e6fe28922bef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.509806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1255f046ce547b29ed745e1d3236453', 'request_id': 'req-917d365b-9ddc-4adc-acff-e6fe28922bef'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.523316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] The token cache is being invalidate because project e1255f046ce547b29ed745e1d3236453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:36.523673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.525041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-917d365b-9ddc-4adc-acff-e6fe28922bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.527003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1094/2211] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:36 2022] DELETE /identity/v3/projects/e1255f046ce547b29ed745e1d3236453 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:36.531865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b702f4-3c0d-45a3-ba78-b284fedae4fb None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.532104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b702f4-3c0d-45a3-ba78-b284fedae4fb None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.532398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b702f4-3c0d-45a3-ba78-b284fedae4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.552717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-16b702f4-3c0d-45a3-ba78-b284fedae4fb None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:36.559141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-16b702f4-3c0d-45a3-ba78-b284fedae4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.594201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:36.595740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38842cb6213b497caaa4c4768242e0f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.595866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:36.596692 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38842cb6213b497caaa4c4768242e0f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.625237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1095/2212] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:36.634516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.634516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.634803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.654818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:36.656031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.665028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1096/2213] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:36.669706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:36.679368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf266ab-51ed-4fe0-8e31-7c06878d8bd1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:36.685486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:36.685486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.685719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.685904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.686640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:48:36.686949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:36.688561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:36.700920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1097/2214] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:48:36.706400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:36.718077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530644-083e-4f37-8bbf-3a98a83b8baa admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:36.720536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:36.721188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.721728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.722540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.723448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:36.725459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:36.726451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38842cb6213b497caaa4c4768242e0f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.727097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38842cb6213b497caaa4c4768242e0f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.735751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-797dd358-b896-4be1-bea1-1ecfd659cf93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38842cb6213b497caaa4c4768242e0f2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:36.761625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1118/2215] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:36 2022] DELETE /identity/v3/users/38842cb6213b497caaa4c4768242e0f2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:36.766105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.766614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.767170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.787076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:36.788316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.827899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1098/2216] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:36 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:48:36.831869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:36.834264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.848331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1119/2217] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:36.863528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:36.864947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:36.914146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346196-c604-4633-91cc-b9b4833e2fbb admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:36.920341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:36.921021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.921312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.921586 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.922484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:36.924412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:36.932741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423da89-5da7-4080-b35d-74e6340a1928 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:36.986261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:36.986912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:36.987193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:36.987469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:36.997771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:36.999622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.016011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1120/2218] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:37.040228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1099/2219] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:36 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:37.044371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.053935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac5b72-b005-46a1-bc21-8adfb978f65a service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.058544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.059196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.059479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.059750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.060700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.062412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.073622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1121/2220] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:37.078621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.114880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa488f-c11a-490e-bdbe-1ec05d28bbc5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.120869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9152a-e8a6-4777-aa55-1b0139296124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.121537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9152a-e8a6-4777-aa55-1b0139296124 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.121821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9152a-e8a6-4777-aa55-1b0139296124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.122139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9152a-e8a6-4777-aa55-1b0139296124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.123466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9152a-e8a6-4777-aa55-1b0139296124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.125505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9152a-e8a6-4777-aa55-1b0139296124 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.140486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1100/2221] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:37.145952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.158231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fe810-cd81-4a13-8ecf-9797452334eb admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.163259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.164173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.164456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.164731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] PATH_INFO: `/v3/projects/2a99f5c1d905411095aaf09ee80746d4/users/56a74097e5e54c69a548b32b65c0f98e/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.180660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a99f5c1d905411095aaf09ee80746d4, user_id=56a74097e5e54c69a548b32b65c0f98e, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.183332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.280405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1122/2222] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:37 2022] PUT /identity/v3/projects/2a99f5c1d905411095aaf09ee80746d4/users/56a74097e5e54c69a548b32b65c0f98e/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:37.291387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.291772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.291951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.326622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] MFA Rules not processed for user `56a74097e5e54c69a548b32b65c0f98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:37.328328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:37.417030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1101/2223] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:37.421525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.488210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34976c5-aa97-4e23-bb89-693a98c0eca3 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.492966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.493701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.494017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.494307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.495297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.497806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.611304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1123/2224] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:37 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:48:37.612784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.634641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.634775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a795b2-ab89-4bd2-a749-81a44e80e54a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.638764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:37.771232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.772075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.772357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.772630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.773678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.776281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.792011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcaf84-b444-41ff-a809-69368499a8da admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.795403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.796425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.796794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.797142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] PATH_INFO: `/v3/projects/9f3d29bc2d4e41f38d20592a1c640294` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.798339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3d29bc2d4e41f38d20592a1c640294)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.800825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.895041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1102/2225] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:37 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:37.899016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.909084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bea87e-16ad-4330-95b6-31873b221922 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.914349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:37.915152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:37.915441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:37.915756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:37.916576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:37.918160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:37.935743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1103/2226] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:37.940449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:37.952777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0f44-f54b-4b61-8775-0b2d8ca5d4fa admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:37.954363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3d29bc2d4e41f38d20592a1c640294', 'request_id': 'req-d94a70bc-a42f-442a-81fd-151a518a4655'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.010871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.011530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.011818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.012165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.015252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.015252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:38.024438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1104/2227] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:38.028647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:38.032591 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3d29bc2d4e41f38d20592a1c640294', 'request_id': 'req-d94a70bc-a42f-442a-81fd-151a518a4655'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.054199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3d29bc2d4e41f38d20592a1c640294', 'request_id': 'req-d94a70bc-a42f-442a-81fd-151a518a4655'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.054312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3a1a-d7ae-4778-9d97-cbc64aa0e0b5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:38.056827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2e44f-fe0f-4440-9736-883f5d812100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.057878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2e44f-fe0f-4440-9736-883f5d812100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.058165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2e44f-fe0f-4440-9736-883f5d812100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.058442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2e44f-fe0f-4440-9736-883f5d812100 admin admin] PATH_INFO: `/v3/projects/66f026297390496db08a55beec7a984e/users/9d0d86d0940f477795ad8e85222035a3/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.069822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] The token cache is being invalidate because project 9f3d29bc2d4e41f38d20592a1c640294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:38.070284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.071348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.074396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1124/2228] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:37 2022] DELETE /identity/v3/projects/9f3d29bc2d4e41f38d20592a1c640294 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:38.085578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2e44f-fe0f-4440-9736-883f5d812100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f026297390496db08a55beec7a984e, user_id=9d0d86d0940f477795ad8e85222035a3, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.087412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:38.088862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2e44f-fe0f-4440-9736-883f5d812100 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:38.089920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:38.110230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a70bc-a42f-442a-81fd-151a518a4655 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:38.116867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.117867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.119468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.119468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] PATH_INFO: `/v3/users/44d515fac3c24967982383d015e99780` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.120014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d515fac3c24967982383d015e99780)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.122141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:38.213951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:38.229033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1105/2229] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:38 2022] PUT /identity/v3/projects/66f026297390496db08a55beec7a984e/users/9d0d86d0940f477795ad8e85222035a3/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:38.240870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.241193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.241611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.286542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] MFA Rules not processed for user `9d0d86d0940f477795ad8e85222035a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:38.287782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:38.293266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:38.352274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d515fac3c24967982383d015e99780'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.352924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d515fac3c24967982383d015e99780'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.367650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1106/2230] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:38.372110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:38.373436 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:38.438471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58076-f83b-4b31-8d37-e09fa8b302a9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:38.444199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.445043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.445330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.445661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.446363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.448384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:38.462639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d515fac3c24967982383d015e99780'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.464310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d515fac3c24967982383d015e99780'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.473067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d515fac3c24967982383d015e99780'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:38.490828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1125/2231] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:38 2022] DELETE /identity/v3/users/44d515fac3c24967982383d015e99780 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:38.577440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1107/2232] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:48:38.579024 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:38.580657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:38.650356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b58b-2d4c-4767-9180-6ac6241b0465 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:38.704706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.705380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.705662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.705940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.707195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.709178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:38.869348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1126/2233] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:38 2022] POST /identity/v3/users => generated 299 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:48:38.870980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:38.881365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761996fb-7c57-497c-ac47-58fedac62170 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:38.886162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.886828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.887111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.887386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.888169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.889875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:38.901340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1108/2234] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:38.905431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:38.915725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992d7c3-1317-42c0-9f02-e332c19ef162 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:38.920504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:38.921408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:38.921687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:38.922014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] PATH_INFO: `/v3/projects/d4530484b8d14d798fe471a2ad7d88a9/users/87877b08337f44c9ab901fbd9c465ec5/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:38.937191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4530484b8d14d798fe471a2ad7d88a9, user_id=87877b08337f44c9ab901fbd9c465ec5, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:38.939975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.014361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.016731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:39.035292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53065-72bc-429d-9321-a08581e5a3bf admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.037176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1127/2235] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:38 2022] PUT /identity/v3/projects/d4530484b8d14d798fe471a2ad7d88a9/users/87877b08337f44c9ab901fbd9c465ec5/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:39.042196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.115578 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.116661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.116951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.117224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] PATH_INFO: `/v3/projects/5a1e0a5da9ac46d19fce8da0e0ce47a6` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.118450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1e0a5da9ac46d19fce8da0e0ce47a6)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.120368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.125816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725fbfd-e565-468c-bf6a-6c3cc7f5f86b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.133426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.134637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.135055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.135341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.136429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.138098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.152084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1128/2236] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:39.154936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.165378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37810ae-9c09-4274-a3d1-1989c5cc43f8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.172098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de15c3-5492-482c-955e-bdbe5b56b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.176940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de15c3-5492-482c-955e-bdbe5b56b32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.176940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de15c3-5492-482c-955e-bdbe5b56b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.176940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de15c3-5492-482c-955e-bdbe5b56b32c admin admin] PATH_INFO: `/v3/projects/d4530484b8d14d798fe471a2ad7d88a9/users/87877b08337f44c9ab901fbd9c465ec5/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.176940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de15c3-5492-482c-955e-bdbe5b56b32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4530484b8d14d798fe471a2ad7d88a9, user_id=87877b08337f44c9ab901fbd9c465ec5, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.178193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de15c3-5492-482c-955e-bdbe5b56b32c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.188639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1129/2237] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:39 2022] PUT /identity/v3/projects/d4530484b8d14d798fe471a2ad7d88a9/users/87877b08337f44c9ab901fbd9c465ec5/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:39.198824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.200342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.200342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.229011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] MFA Rules not processed for user `87877b08337f44c9ab901fbd9c465ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:39.230253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:39.265158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1e0a5da9ac46d19fce8da0e0ce47a6', 'request_id': 'req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:39.271859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1e0a5da9ac46d19fce8da0e0ce47a6', 'request_id': 'req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:39.303946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1130/2238] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:39.314572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.316369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:39.364527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1e0a5da9ac46d19fce8da0e0ce47a6', 'request_id': 'req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:39.375881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750283f-e82d-4985-8846-9ae03c9f1637 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.386773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] The token cache is being invalidate because project 5a1e0a5da9ac46d19fce8da0e0ce47a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:39.393161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:39.393161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f855fc1-cd7a-4f4c-a0cd-878d8089c68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:39.393161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1109/2239] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:39 2022] DELETE /identity/v3/projects/5a1e0a5da9ac46d19fce8da0e0ce47a6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:39.397713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85d89-5bf8-433f-bd05-62ec37402a20 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.398011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85d89-5bf8-433f-bd05-62ec37402a20 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.398297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85d89-5bf8-433f-bd05-62ec37402a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.421636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b0c85d89-5bf8-433f-bd05-62ec37402a20 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:39.421636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b0c85d89-5bf8-433f-bd05-62ec37402a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:39.429101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.429888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.430264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.430645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.432570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:39.491314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1110/2240] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:39.497399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.498873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.499406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.499646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.500082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.508947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1131/2241] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:48:39.521400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:39.522674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:39.528267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:39.533491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1111/2242] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:39.539480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.550974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ea678-4c52-42ec-82dd-4dddcc3482e6 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.556764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.557619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.558086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.558365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.559108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:48:39.559442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.561105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.579777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1132/2243] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:48:39.588106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.594450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38305-6940-43ed-bfdb-517d3f1c405e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.601630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.602377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.603106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.603403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.604712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.608240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.746863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1112/2244] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:39 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:48:39.750706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.761043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2bdc9-39e4-43a7-ac83-d210d11a1d64 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.820585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.821312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.821596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.821900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.822604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.824645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.900258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1133/2245] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:39 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:39.901919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.914534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4ace9-46f2-45c9-ace8-85feb73d0a0e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.919278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.920117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.924227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.924227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.924227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.924227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.939468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1113/2246] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:39.944387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.954548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf140-e444-427e-96bc-a75fec479d95 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.960833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dc400-b715-48f3-b639-927227c7da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.961544 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc400-b715-48f3-b639-927227c7da4e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.961796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc400-b715-48f3-b639-927227c7da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.962067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc400-b715-48f3-b639-927227c7da4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:39.962791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dc400-b715-48f3-b639-927227c7da4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:39.964651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dc400-b715-48f3-b639-927227c7da4e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:39.979476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1134/2247] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:39.980738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:39.991353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bccec5-fe98-4ad7-9d8d-4729f6b54671 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:39.995463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:39.996455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:39.997381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:39.997693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:39.997979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] PATH_INFO: `/v3/projects/f368d20c67514fcabd2234701da0f602/users/cb7484e3637e491dac60ede9f3582a99/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:40.014989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f368d20c67514fcabd2234701da0f602, user_id=cb7484e3637e491dac60ede9f3582a99, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:40.109035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:40.222007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1114/2248] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:39 2022] PUT /identity/v3/projects/f368d20c67514fcabd2234701da0f602/users/cb7484e3637e491dac60ede9f3582a99/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:40.231499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:40.232071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:40.232536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:40.276450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] MFA Rules not processed for user `cb7484e3637e491dac60ede9f3582a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:40.277696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:40.344045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1135/2249] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:40.349707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:40.437955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559fe78-0c3b-4afc-8971-59b2590d2ebe admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:40.443155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:40.443828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:40.444142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:40.444794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:40.445504 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:40.447397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:40.578854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1115/2250] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:40 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:40.580651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:40.584973 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:40.610070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233379c2-3216-4e2b-aa56-24e9d23cbad0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:40.683840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:40.684562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:40.689827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:40.689827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:40.689827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:40.689827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:40.803219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1136/2251] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:40 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:48:40.806752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:40.820697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310bdf-88d9-4c2c-b032-00e2c9922608 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:40.830346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:40.832274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:40.832274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:40.832274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:40.832572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:40.836147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:40.862400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1116/2252] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:40.864420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:40.877250 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054422-3e2d-4f89-9bcb-e32bb31a41e1 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:40.883712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:40.884651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:40.884931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:40.885224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] PATH_INFO: `/v3/projects/aca21c302dcd4307ae1de5ece0d6f9ec/users/6e12ce474f514706b1f896b37c4a7afe/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:40.901749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca21c302dcd4307ae1de5ece0d6f9ec, user_id=6e12ce474f514706b1f896b37c4a7afe, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:40.904489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:41.018679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1137/2253] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:40 2022] PUT /identity/v3/projects/aca21c302dcd4307ae1de5ece0d6f9ec/users/6e12ce474f514706b1f896b37c4a7afe/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:41.027373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:41.033096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e80ae-8222-43c1-b15b-d1c7b88201c4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:41.102252 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218ee16-946c-41e5-8ce6-780d4304260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:41.102950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ee16-946c-41e5-8ce6-780d4304260c admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:41.103236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ee16-946c-41e5-8ce6-780d4304260c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:41.103513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ee16-946c-41e5-8ce6-780d4304260c admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:41.104323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ee16-946c-41e5-8ce6-780d4304260c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:41.105948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ee16-946c-41e5-8ce6-780d4304260c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:41.116312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1117/2254] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:41.120509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:41.131298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ed0d3-1b6c-4110-b1cb-e10414373d01 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:41.135958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:41.136881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:41.137163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:41.137436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] PATH_INFO: `/v3/projects/aca21c302dcd4307ae1de5ece0d6f9ec/users/6e12ce474f514706b1f896b37c4a7afe/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:41.139470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca21c302dcd4307ae1de5ece0d6f9ec, user_id=6e12ce474f514706b1f896b37c4a7afe, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:41.142195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:41.159117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1138/2255] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:41 2022] PUT /identity/v3/projects/aca21c302dcd4307ae1de5ece0d6f9ec/users/6e12ce474f514706b1f896b37c4a7afe/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:41.159117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:41.165789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:41.166163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:41.166516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:41.194382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] MFA Rules not processed for user `6e12ce474f514706b1f896b37c4a7afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:41.195605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:41.276701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1118/2256] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:41.287871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:41.289782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:41.355390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8cc4d-75dd-4bd5-a4e7-aea0672a237c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:41.359657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:41.360508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:41.360862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:41.361274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:41.372352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:41.372632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:41.383609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1139/2257] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:41.392978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:41.496332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:41.507863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d1ab-f01e-4db1-8fb3-a32d4a6b866a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:41.511426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:41.512098 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:41.512809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:41.512809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:41.577006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:41.578497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:41.588649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1119/2258] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:41.618496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:42.046583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:42.210004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:42.211707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:42.225068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171d45f-5047-4547-9f8c-fec22202eeb2 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:42.229107 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:42.229765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:42.230050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:42.230301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:42.232077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:42.300343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:42.301994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:42.311825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1140/2259] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:42.481479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:43.900704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:43.904977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:43.910117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac741d4-5db2-4da7-96f4-a18b9ebe0bd2 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:43.914155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:43.914798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:43.915080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:43.915350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:43.917324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:44.002163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:44.005333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19112cd9-c1f0-49ce-b33e-5d9282ca6380 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:44.017484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1120/2260] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:44.780967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:44.850435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e982-3a1d-40b0-a5a8-8292100c8bc3 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:44.857264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:44.858162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:44.858447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:44.858724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] PATH_INFO: `/v3/users/cb7484e3637e491dac60ede9f3582a99` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:44.859937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7484e3637e491dac60ede9f3582a99)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:44.861987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:45.044995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7484e3637e491dac60ede9f3582a99'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:45.045934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7484e3637e491dac60ede9f3582a99'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:45.121033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7484e3637e491dac60ede9f3582a99'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:45.121888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7484e3637e491dac60ede9f3582a99'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:45.131807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7484e3637e491dac60ede9f3582a99'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:45.158706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1141/2261] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:44 2022] DELETE /identity/v3/users/cb7484e3637e491dac60ede9f3582a99 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:45.163519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:45.164136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:45.164136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:45.194192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:45.195452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:45.260203 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1121/2262] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:45.270253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:45.272472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:45.316806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:45.339799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7515a0b-e0e4-40cb-a2e2-e0dc74232b6e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:45.343500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:45.344166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:45.344448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:45.344721 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:45.354513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:45.356001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:45.367267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1142/2263] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:46.039986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:46.041771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:46.060432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f84eb-d545-4a49-943b-142034da3333 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:46.073741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:46.074681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:46.075046 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:46.075229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] PATH_INFO: `/v3/projects/f368d20c67514fcabd2234701da0f602` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:46.076514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f368d20c67514fcabd2234701da0f602)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:46.078313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:46.194929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f368d20c67514fcabd2234701da0f602', 'request_id': 'req-9f73ff5c-809d-44ce-b89d-88ea8d261f31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.201389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f368d20c67514fcabd2234701da0f602', 'request_id': 'req-9f73ff5c-809d-44ce-b89d-88ea8d261f31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.257891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f368d20c67514fcabd2234701da0f602', 'request_id': 'req-9f73ff5c-809d-44ce-b89d-88ea8d261f31'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.269655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] The token cache is being invalidate because project f368d20c67514fcabd2234701da0f602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:46.269940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.270594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.272185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1122/2264] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:46 2022] DELETE /identity/v3/projects/f368d20c67514fcabd2234701da0f602 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:46.276235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:46.286214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878169f-630d-4f4c-af53-526795d8e1d7 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:46.343811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:46.344728 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:46.345017 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:46.345293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] PATH_INFO: `/v3/users/6e12ce474f514706b1f896b37c4a7afe` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:46.347277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e12ce474f514706b1f896b37c4a7afe)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:46.349248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:46.536399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e12ce474f514706b1f896b37c4a7afe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.537045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e12ce474f514706b1f896b37c4a7afe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.606447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e12ce474f514706b1f896b37c4a7afe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.607055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e12ce474f514706b1f896b37c4a7afe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.616311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e58adafd-7551-459d-88c9-216e555163eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e12ce474f514706b1f896b37c4a7afe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:46.634636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1143/2265] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:46 2022] DELETE /identity/v3/users/6e12ce474f514706b1f896b37c4a7afe => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:47.126205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:47.130060 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:47.158788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ff5c-809d-44ce-b89d-88ea8d261f31 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:47.177404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:47.237921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:47.238871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:47.239149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:47.239424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] PATH_INFO: `/v3/projects/aca21c302dcd4307ae1de5ece0d6f9ec` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:47.240836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca21c302dcd4307ae1de5ece0d6f9ec)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:47.242912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:47.371668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca21c302dcd4307ae1de5ece0d6f9ec', 'request_id': 'req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:47.377921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca21c302dcd4307ae1de5ece0d6f9ec', 'request_id': 'req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:47.492428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca21c302dcd4307ae1de5ece0d6f9ec', 'request_id': 'req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:47.504023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] The token cache is being invalidate because project aca21c302dcd4307ae1de5ece0d6f9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:47.504363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:47.505022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-987e1858-7db4-4f8e-9fcd-6d9e99c4e48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:47.507270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1123/2266] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:47 2022] DELETE /identity/v3/projects/aca21c302dcd4307ae1de5ece0d6f9ec => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:47.511916 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:47.512420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:47.512538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:47.564541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:47.566710 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:47.610918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:47.637639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1144/2267] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:47.646584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:47.646908 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:47.647412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:47.687511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:47.691764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:47.701666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1124/2268] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:47.705949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:47.720319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f9f54-1d82-4bda-9f15-4d995fd399bc None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:47.726042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:47.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:47.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:47.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:47.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:48:47.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:47.733579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:47.743150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1145/2269] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:48:47.748185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:47.763534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf847-8efb-48ef-891a-30ec9d15d775 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:47.768652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:47.769471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:47.769758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:47.770037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:47.770734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:47.772680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:47.913026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1125/2270] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:47 2022] POST /identity/v3/projects => generated 409 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:47.922180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:47.932956 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5533f-b408-4acc-857a-7ff629d5ac8b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:47.993215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:47.993915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:47.994163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:47.994441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:47.995141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:47.997132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.132909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1146/2271] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:47 2022] POST /identity/v3/users => generated 305 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:48.134458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.145865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df723cf-01d8-436d-b80e-d93816e28adf admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.150569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.151692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.151692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.152003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.152593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.154279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.184389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1126/2272] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:48.194688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.208491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ee903-970d-454f-bc6c-ca9293928b61 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.217188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed7c57-d7da-4227-a448-ebb711e59994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.218495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed7c57-d7da-4227-a448-ebb711e59994 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.218495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed7c57-d7da-4227-a448-ebb711e59994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.218676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed7c57-d7da-4227-a448-ebb711e59994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.220018 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed7c57-d7da-4227-a448-ebb711e59994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.221648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed7c57-d7da-4227-a448-ebb711e59994 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.237682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1147/2273] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:48.238688 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.253427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7446f5-83c5-44fe-8c71-4d6a1e703741 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.258616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.259512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.259938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.260319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] PATH_INFO: `/v3/projects/14fccb78f92e4e2aa75087783edf46c4/users/f8734561619049339b3bdcd2777acec9/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.279550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fccb78f92e4e2aa75087783edf46c4, user_id=f8734561619049339b3bdcd2777acec9, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.282411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.410760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1127/2274] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:48 2022] PUT /identity/v3/projects/14fccb78f92e4e2aa75087783edf46c4/users/f8734561619049339b3bdcd2777acec9/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:48.422257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e787-79a9-4f58-a347-862896c357aa None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.422637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e787-79a9-4f58-a347-862896c357aa None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.422922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e787-79a9-4f58-a347-862896c357aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.460318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9532e787-79a9-4f58-a347-862896c357aa None None] MFA Rules not processed for user `f8734561619049339b3bdcd2777acec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:48.463658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9532e787-79a9-4f58-a347-862896c357aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:48.540134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1148/2275] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:48.544950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.590840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:48.611345 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088589c0-c467-4405-91b8-ad5478edd5a8 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.617465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.620623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.620623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.620623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.620623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.621428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.738957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1128/2276] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:48:48 2022] POST /identity/v3/projects => generated 409 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:48.742443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532e787-79a9-4f58-a347-862896c357aa None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.757167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532e787-79a9-4f58-a347-862896c357aa None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.806451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:48.837336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.839295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.839586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.839889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.840601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.842605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.855163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.857006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:48.871783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0481-8830-41ce-839b-64d69e320c6d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.877165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.880127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.880127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.880127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] PATH_INFO: `/v3/users/56a74097e5e54c69a548b32b65c0f98e` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.880457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a74097e5e54c69a548b32b65c0f98e)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.882179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.933408 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1149/2277] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:48:48 2022] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:48:48.940997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.952287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b27b7-34f5-4c89-a29c-24309130c7aa admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.957980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.958650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.958934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.959213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:48.959934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:48.961576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:48.972092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1150/2278] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:48:48.976505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:48.988588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d8e75-5a12-48b3-b130-62efd4e763ec admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:48.993545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:48.994431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:48.994712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:48.994985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] PATH_INFO: `/v3/projects/ea01d15f666944948f72663d879c899b/users/d4b11d83a83946969d1b548c7b72dea8/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.010805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea01d15f666944948f72663d879c899b, user_id=d4b11d83a83946969d1b548c7b72dea8, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:49.016199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:49.084860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a74097e5e54c69a548b32b65c0f98e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:49.106513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1151/2279] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:48 2022] PUT /identity/v3/projects/ea01d15f666944948f72663d879c899b/users/d4b11d83a83946969d1b548c7b72dea8/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:49.110892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:49.155855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a74097e5e54c69a548b32b65c0f98e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:49.156694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a74097e5e54c69a548b32b65c0f98e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:49.157428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a74097e5e54c69a548b32b65c0f98e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:49.166194 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d0a46972-71cc-4755-848a-1baef3757004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a74097e5e54c69a548b32b65c0f98e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:49.182966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b666-133a-46cb-a328-b7a8f032a8e0 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:49.188127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:49.189950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.189950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.189950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.190392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:49.192685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:49.194470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1129/2280] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:48 2022] DELETE /identity/v3/users/56a74097e5e54c69a548b32b65c0f98e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:49.199283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.200493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.201010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.204189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1152/2281] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:48:49.209260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:49.214366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:49.229793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:49.230891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d11f95-4d09-4bdd-8b11-6ba671eebfcd admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:49.231379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:49.309907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1130/2282] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:48:49.331235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b397f88-9ded-44e6-b78d-0bd33af964b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:49.332182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397f88-9ded-44e6-b78d-0bd33af964b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.332620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397f88-9ded-44e6-b78d-0bd33af964b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.332907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397f88-9ded-44e6-b78d-0bd33af964b9 admin admin] PATH_INFO: `/v3/projects/ea01d15f666944948f72663d879c899b/users/d4b11d83a83946969d1b548c7b72dea8/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.334253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:49.335172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b397f88-9ded-44e6-b78d-0bd33af964b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea01d15f666944948f72663d879c899b, user_id=d4b11d83a83946969d1b548c7b72dea8, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:49.335764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:49.338127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b397f88-9ded-44e6-b78d-0bd33af964b9 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:49.360504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1153/2283] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:48:49 2022] PUT /identity/v3/projects/ea01d15f666944948f72663d879c899b/users/d4b11d83a83946969d1b548c7b72dea8/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:48:49.362478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.362777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.363061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.403560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] MFA Rules not processed for user `d4b11d83a83946969d1b548c7b72dea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:49.404826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:49.426153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:49.457782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:49.484644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffaa45-a93e-413e-8e34-f7959cbafd59 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:49.544808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1154/2284] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:49.556979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:49.558764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:49.580356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee19f5d-f6d7-459a-bb9f-1fc2f92e575c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:49.581585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19f5d-f6d7-459a-bb9f-1fc2f92e575c service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.582315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19f5d-f6d7-459a-bb9f-1fc2f92e575c service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.582315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19f5d-f6d7-459a-bb9f-1fc2f92e575c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.642924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93439ebc-c4c5-49d1-a75f-b832b426eaa3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:49.646817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:49.647536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.647798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.648106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.655400 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19f5d-f6d7-459a-bb9f-1fc2f92e575c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:49.657532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19f5d-f6d7-459a-bb9f-1fc2f92e575c service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:49.664365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:49.667348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:49.672925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1131/2285] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:49.673930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:49.674224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:49.674634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:49.692363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1155/2286] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:48:49.700903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] MFA Rules not processed for user `85e0d647620a407cbe03d83c86111f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:48:49.702519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:49.796839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1132/2287] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:48:50.102701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:50.105884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:50.134356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509de3d9-327b-4078-8ae3-1bf1323aca2c service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:50.139292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:50.140253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:50.140616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:50.140784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] PATH_INFO: `/v3/projects/2a99f5c1d905411095aaf09ee80746d4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:50.142511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a99f5c1d905411095aaf09ee80746d4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:50.145257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:50.203746 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:50.214443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c279af-975e-4be1-8309-a590e2f43811 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:50.218279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:50.219018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:50.219416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:50.219866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:50.222128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:50.288630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:50.290067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:50.299737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1133/2288] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:48:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:48:50.329996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a99f5c1d905411095aaf09ee80746d4', 'request_id': 'req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:50.347439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:50.462022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a99f5c1d905411095aaf09ee80746d4', 'request_id': 'req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:50.470677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a99f5c1d905411095aaf09ee80746d4', 'request_id': 'req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:50.493505 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] The token cache is being invalidate because project 2a99f5c1d905411095aaf09ee80746d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:50.493918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:50.498519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:50.498519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1156/2289] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:50 2022] DELETE /identity/v3/projects/2a99f5c1d905411095aaf09ee80746d4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:50.509179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:50.511748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3119777-79e1-4f4c-82b2-779b8af5b0f2 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:50.592528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:50.594132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:50.594861 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:50.595308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] PATH_INFO: `/v3/users/9d0d86d0940f477795ad8e85222035a3` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:50.597753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0d86d0940f477795ad8e85222035a3)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:50.600547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:50.943364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0d86d0940f477795ad8e85222035a3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.029257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0d86d0940f477795ad8e85222035a3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.030048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0d86d0940f477795ad8e85222035a3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.030733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0d86d0940f477795ad8e85222035a3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.040208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0d86d0940f477795ad8e85222035a3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.068037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1134/2290] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:50 2022] DELETE /identity/v3/users/9d0d86d0940f477795ad8e85222035a3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:51.587586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:51.589699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:51.603839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b0b92-d79f-49b1-9082-3fa0d2dd495b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:51.635119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:51.664356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:51.665350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:51.665629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:51.665936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] PATH_INFO: `/v3/projects/66f026297390496db08a55beec7a984e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:51.667202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f026297390496db08a55beec7a984e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:51.669813 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:51.830581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f026297390496db08a55beec7a984e', 'request_id': 'req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.919375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f026297390496db08a55beec7a984e', 'request_id': 'req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.931701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f026297390496db08a55beec7a984e', 'request_id': 'req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.944805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] The token cache is being invalidate because project 66f026297390496db08a55beec7a984e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:51.945116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.949215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:51.949215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1157/2291] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:51 2022] DELETE /identity/v3/projects/66f026297390496db08a55beec7a984e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:51.951592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:51.953830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:51.970226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b7d03-4413-408a-9fbe-cde740c184b5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:52.048486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:52.049524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:52.049987 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:52.050300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] PATH_INFO: `/v3/users/87877b08337f44c9ab901fbd9c465ec5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:52.051621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87877b08337f44c9ab901fbd9c465ec5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:52.053580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:52.060485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:52.291805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87877b08337f44c9ab901fbd9c465ec5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:52.395566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87877b08337f44c9ab901fbd9c465ec5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:52.395566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87877b08337f44c9ab901fbd9c465ec5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:52.396089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87877b08337f44c9ab901fbd9c465ec5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:52.403675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87877b08337f44c9ab901fbd9c465ec5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:52.422647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1135/2292] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:48:51 2022] DELETE /identity/v3/users/87877b08337f44c9ab901fbd9c465ec5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:52.965767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:48:52.967287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:48:52.982807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202b6e-5ec0-4f08-b3ce-305c63112fc9 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:48:53.057204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:48:53.058065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:48:53.058864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:48:53.058864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] PATH_INFO: `/v3/projects/d4530484b8d14d798fe471a2ad7d88a9` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:48:53.060330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4530484b8d14d798fe471a2ad7d88a9)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:48:53.062529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:48:53.170599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4530484b8d14d798fe471a2ad7d88a9', 'request_id': 'req-8fd87be4-c0ff-4aef-bd58-640047095738'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:53.260560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4530484b8d14d798fe471a2ad7d88a9', 'request_id': 'req-8fd87be4-c0ff-4aef-bd58-640047095738'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:53.266276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4530484b8d14d798fe471a2ad7d88a9', 'request_id': 'req-8fd87be4-c0ff-4aef-bd58-640047095738'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:53.278658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] The token cache is being invalidate because project d4530484b8d14d798fe471a2ad7d88a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:48:53.278944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:53.279730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8fd87be4-c0ff-4aef-bd58-640047095738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:48:53.281621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1158/2293] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:48:52 2022] DELETE /identity/v3/projects/d4530484b8d14d798fe471a2ad7d88a9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:48:53.423806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:00.514379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:00.515803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:00.528826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0d03c-4c25-46da-b9ca-22992ec30c90 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:00.584748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:00.585614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:00.585896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:00.586172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] PATH_INFO: `/v3/users/f8734561619049339b3bdcd2777acec9` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:00.587351 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8734561619049339b3bdcd2777acec9)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:00.589707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:00.748179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8734561619049339b3bdcd2777acec9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:00.811529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8734561619049339b3bdcd2777acec9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:00.812161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8734561619049339b3bdcd2777acec9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:00.812790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8734561619049339b3bdcd2777acec9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:00.820067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8734561619049339b3bdcd2777acec9'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:00.837463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1136/2294] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:00 2022] DELETE /identity/v3/users/f8734561619049339b3bdcd2777acec9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:00.842062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:00.842559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:00.842664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:00.860646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:00.862446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:00.920682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1159/2295] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:00.931184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:00.932612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:00.939298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:00.992898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9f14-cfc8-4087-862d-251f53472759 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:00.996796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:00.997492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:00.997719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:01.000665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:01.007731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:01.009193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:01.019249 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1137/2296] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:01.572282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:01.576226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:01.586572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd333588-880b-4ee1-a18c-fd587e7fcdc4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:01.591261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:01.592170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:01.592450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:01.592954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] PATH_INFO: `/v3/projects/14fccb78f92e4e2aa75087783edf46c4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:01.594106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fccb78f92e4e2aa75087783edf46c4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:01.596244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:01.727862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fccb78f92e4e2aa75087783edf46c4', 'request_id': 'req-807ea3aa-141a-4e46-9600-f809880481bc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:01.812121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fccb78f92e4e2aa75087783edf46c4', 'request_id': 'req-807ea3aa-141a-4e46-9600-f809880481bc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:01.820266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fccb78f92e4e2aa75087783edf46c4', 'request_id': 'req-807ea3aa-141a-4e46-9600-f809880481bc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:01.835776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] The token cache is being invalidate because project 14fccb78f92e4e2aa75087783edf46c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:01.836077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:01.836753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:01.838295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1160/2297] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:01 2022] DELETE /identity/v3/projects/14fccb78f92e4e2aa75087783edf46c4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:01.842758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:01.852726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9780b15-e6f7-4323-a26a-8f414d19ae47 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:01.916849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:01.917728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:01.918012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:01.918291 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] PATH_INFO: `/v3/users/d4b11d83a83946969d1b548c7b72dea8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:01.919529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b11d83a83946969d1b548c7b72dea8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:01.921486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:02.122600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b11d83a83946969d1b548c7b72dea8'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:02.176955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b11d83a83946969d1b548c7b72dea8'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:02.177610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b11d83a83946969d1b548c7b72dea8'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:02.178228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b11d83a83946969d1b548c7b72dea8'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:02.185996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a39bc8fc-0eb2-4786-b8a5-a2c49f5e0bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b11d83a83946969d1b548c7b72dea8'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:02.204751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1138/2298] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:01 2022] DELETE /identity/v3/users/d4b11d83a83946969d1b548c7b72dea8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:02.699661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:02.703152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:02.716130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea3aa-141a-4e46-9600-f809880481bc admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:02.774180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:02.775040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:02.775318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:02.775589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] PATH_INFO: `/v3/projects/ea01d15f666944948f72663d879c899b` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:02.776727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea01d15f666944948f72663d879c899b)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:02.778623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:02.794545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:02.917387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea01d15f666944948f72663d879c899b', 'request_id': 'req-2463a316-b31c-450a-93ee-6461045d4ea8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:03.031361 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea01d15f666944948f72663d879c899b', 'request_id': 'req-2463a316-b31c-450a-93ee-6461045d4ea8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:03.037906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea01d15f666944948f72663d879c899b', 'request_id': 'req-2463a316-b31c-450a-93ee-6461045d4ea8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:03.049718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] The token cache is being invalidate because project ea01d15f666944948f72663d879c899b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:03.050005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:03.050707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2463a316-b31c-450a-93ee-6461045d4ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:03.052277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1161/2299] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:02 2022] DELETE /identity/v3/projects/ea01d15f666944948f72663d879c899b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:03.057633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.058126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.058332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.086742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:03.088045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:03.105596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:03.152408 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1139/2300] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:03.160933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.161215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.161486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.189564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:03.189564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:03.189564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1162/2301] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:03.193476 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.202992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173d1d-e9b9-4ae2-a199-0ce9356e1b5e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.209208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.209914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.210198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.210477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.211204 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:49:03.211516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.213150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:03.225828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1140/2302] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:49:03.230077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.239515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e12e8b-4226-4802-aab1-1a20632c420e None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.244253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.244922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.245193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.245474 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.246172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.248114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:03.364300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1163/2303] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:03 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:49:03.368812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.379563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335452e-8cd6-40da-994a-2cc87678a6dd admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.438242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.439049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.439501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.440100 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.440815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.442860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:03.530481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1141/2304] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:03 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:03.533634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.545559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0cf6-8450-4d6c-b248-43f89502b450 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.550812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.551529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.551814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.552401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.552940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.554554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:03.565518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1164/2305] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:03.569617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.579604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb12e-1802-495a-a2ad-3a3add58266c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.585216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85d76e-c20a-46c5-8887-ff0692474ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.585875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85d76e-c20a-46c5-8887-ff0692474ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.586162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85d76e-c20a-46c5-8887-ff0692474ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.586440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85d76e-c20a-46c5-8887-ff0692474ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.587169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85d76e-c20a-46c5-8887-ff0692474ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.588795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85d76e-c20a-46c5-8887-ff0692474ba2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:03.599910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1142/2306] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:03.609598 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.619893 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ac4d-f169-4d6e-a6c2-87e07ddc122c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.624590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.625499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.625785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.626069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] PATH_INFO: `/v3/projects/6bdb23de6b494ffdbfee7b902eef0172/users/90106c89d16f42c29bd16c530fce2800/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.641517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdb23de6b494ffdbfee7b902eef0172, user_id=90106c89d16f42c29bd16c530fce2800, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.644852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:03.731276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1165/2307] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:03 2022] PUT /identity/v3/projects/6bdb23de6b494ffdbfee7b902eef0172/users/90106c89d16f42c29bd16c530fce2800/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:03.748848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.749708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.749708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.784891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] MFA Rules not processed for user `90106c89d16f42c29bd16c530fce2800`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:03.787313 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:03.858834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1143/2308] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:03.863631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:03.931897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749875a-841b-4238-b66a-969838a32736 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:03.936860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:03.937531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:03.937816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:03.938094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:03.938816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:03.941910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.022356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1166/2309] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:03 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:04.026488 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.038692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2019-e833-4b33-b00c-9e6a12450cd3 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.048266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:04.101281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.102369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.102369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.102506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.103369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:04.105428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.239942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1144/2310] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:04 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:04.243998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.254946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ce7ec-09c6-42fd-9d1e-94c1a39e2c9f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.259490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.260188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.260473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.260749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.261499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:04.263282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.278317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1167/2311] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:04.279423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.290693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabb3f7-3878-42cd-9d54-fd746b8f6118 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.295852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.296816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.297101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.297381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] PATH_INFO: `/v3/projects/1048fd63a1c044ccb01a62f860d59c4e/users/37226d4db80143c486fe14a429cf29f3/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.313431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1048fd63a1c044ccb01a62f860d59c4e, user_id=37226d4db80143c486fe14a429cf29f3, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:04.317265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.413000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1145/2312] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:04 2022] PUT /identity/v3/projects/1048fd63a1c044ccb01a62f860d59c4e/users/37226d4db80143c486fe14a429cf29f3/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:04.416901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.427622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c09a8-aeeb-4237-bfb0-912d570d964b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.438898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:04.482185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21ec8-f080-4f3f-8285-f5fb429db70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.482840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21ec8-f080-4f3f-8285-f5fb429db70c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.483124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21ec8-f080-4f3f-8285-f5fb429db70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.483397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21ec8-f080-4f3f-8285-f5fb429db70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.484131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a21ec8-f080-4f3f-8285-f5fb429db70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:04.485725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a21ec8-f080-4f3f-8285-f5fb429db70c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.496068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1168/2313] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:04.500637 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.511195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dc93f-ae0a-4d70-8220-a12342cd307f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.515821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.516740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.517008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.517284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] PATH_INFO: `/v3/projects/1048fd63a1c044ccb01a62f860d59c4e/users/37226d4db80143c486fe14a429cf29f3/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.519456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1048fd63a1c044ccb01a62f860d59c4e, user_id=37226d4db80143c486fe14a429cf29f3, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:04.522132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.532124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1146/2314] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:04 2022] PUT /identity/v3/projects/1048fd63a1c044ccb01a62f860d59c4e/users/37226d4db80143c486fe14a429cf29f3/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:04.543655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.543972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.544290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.571479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] MFA Rules not processed for user `37226d4db80143c486fe14a429cf29f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:04.572756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:04.642489 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1169/2315] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:04.653938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.655866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:04.719056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5505-6c74-461d-9462-03e58a4f06d2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.723843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c13f8-2446-479f-8a7d-e195b903e0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.724546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c13f8-2446-479f-8a7d-e195b903e0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.724833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c13f8-2446-479f-8a7d-e195b903e0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.725110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c13f8-2446-479f-8a7d-e195b903e0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:04.735352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c13f8-2446-479f-8a7d-e195b903e0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:04.737430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c13f8-2446-479f-8a7d-e195b903e0e4 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:04.748294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1147/2316] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:04.977134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:04.987764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de8422-68a2-4066-8ad2-bba5e5d1747a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:04.991427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:04.992098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:04.992387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:04.992667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:05.066426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:05.067416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:05.079994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1170/2317] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:14.368352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:14.374864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:14.374864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:14.410119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:14.411317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:14.473712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:14.481270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1148/2318] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:14.535456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:14.537097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:14.591285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:14.632114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae201cf-37c6-4927-a04a-1a8fd6111c8d service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:14.637557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:14.639510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:14.639510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:14.639510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:14.648271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:14.649870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:14.659150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1171/2319] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:49:15.632105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:15.633560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:15.725527 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033907-e402-4945-9bc1-b315c86ee59c None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:15.731682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:15.732857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:15.733174 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:15.733495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] PATH_INFO: `/v3/users/b21385f40f4045078185753081f4b689` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:15.734714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21385f40f4045078185753081f4b689)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:15.737002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:16.191790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21385f40f4045078185753081f4b689'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.243845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:16.257820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f55ec0-fc72-435a-95c5-6045993cd17a service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:16.262968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:16.264168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:16.264453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:16.265046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] PATH_INFO: `/v3/users/90106c89d16f42c29bd16c530fce2800` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:16.266494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=90106c89d16f42c29bd16c530fce2800)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:16.268690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:16.282245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21385f40f4045078185753081f4b689'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.282902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21385f40f4045078185753081f4b689'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.283530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21385f40f4045078185753081f4b689'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.299724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-4d289cc5-b5ef-43fe-90a1-7d742507909c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21385f40f4045078185753081f4b689'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.324801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1149/2320] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:15 2022] DELETE /identity/v3/users/b21385f40f4045078185753081f4b689 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:16.330566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:16.333009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:16.333009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:16.354912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:16.356190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:16.444183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1150/2321] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:16.455284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:16.456822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:16.475477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90106c89d16f42c29bd16c530fce2800'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.476634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90106c89d16f42c29bd16c530fce2800'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.486693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:16.545884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753b60-35cd-4207-a4a0-9d4709df7da9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:16.551511 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe68802-6271-48ed-8ce3-0d72d761835a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:16.552234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68802-6271-48ed-8ce3-0d72d761835a service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:16.552515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68802-6271-48ed-8ce3-0d72d761835a service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:16.552785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68802-6271-48ed-8ce3-0d72d761835a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:16.569466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe68802-6271-48ed-8ce3-0d72d761835a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:16.569466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe68802-6271-48ed-8ce3-0d72d761835a service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:16.582416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1151/2322] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:49:16.588286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90106c89d16f42c29bd16c530fce2800'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.588905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90106c89d16f42c29bd16c530fce2800'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.607986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90106c89d16f42c29bd16c530fce2800'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:16.631181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1172/2323] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:16 2022] DELETE /identity/v3/users/90106c89d16f42c29bd16c530fce2800 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:49:16.642399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:16.642399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:16.642399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:16.662238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:16.663950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:16.743843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1152/2324] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:16.756845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:16.758314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:16.831967 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de05244-e774-4aa0-970f-95fa6177f2bc admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:16.835871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:16.836559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:16.836871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:16.837111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:16.848465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:16.853038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:16.872244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1173/2325] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:17.277183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:17.281941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:17.291546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008e22-7217-4dee-a890-3fbf106bd560 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:17.299383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:17.300237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:17.300524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:17.300798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] PATH_INFO: `/v3/projects/abb3513324ac4a029b00b1ffda447616` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:17.302039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb3513324ac4a029b00b1ffda447616)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:17.303997 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:17.518175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb3513324ac4a029b00b1ffda447616', 'request_id': 'req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:17.527784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb3513324ac4a029b00b1ffda447616', 'request_id': 'req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:17.628885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:17.628885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:17.648741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb3513324ac4a029b00b1ffda447616', 'request_id': 'req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:17.664229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] The token cache is being invalidate because project abb3513324ac4a029b00b1ffda447616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:17.664229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:17.680425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a33eb724-2d1b-4bd7-903d-cbd95a25e2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:17.684542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea5a6c-22e2-4e37-9267-cdb92eeef782 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:17.694459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1153/2326] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:17 2022] DELETE /identity/v3/projects/abb3513324ac4a029b00b1ffda447616 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:17.695238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38577ec-5f9b-4ebd-8d7d-cade29fd7d4c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:17.696318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38577ec-5f9b-4ebd-8d7d-cade29fd7d4c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:17.696607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38577ec-5f9b-4ebd-8d7d-cade29fd7d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:17.758228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c38577ec-5f9b-4ebd-8d7d-cade29fd7d4c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:17.759497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c38577ec-5f9b-4ebd-8d7d-cade29fd7d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:17.799399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:17.827050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:17.846951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:17.846951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:17.846951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] PATH_INFO: `/v3/projects/6bdb23de6b494ffdbfee7b902eef0172` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:17.846951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdb23de6b494ffdbfee7b902eef0172)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:17.846951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:17.847671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:17.863705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1154/2327] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:17.865451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:17.865749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:17.866078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:17.886673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:17.887944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:17.901216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1155/2328] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:17.901216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:17.917676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae309b8-f9f3-43a1-bf48-ccdabe545fba None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:17.923160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:17.923962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:17.924302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:17.924628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:17.925425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:49:17.925768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:17.927724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:17.941682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1156/2329] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:49:17.945268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:17.956260 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ffb01-aef1-4d45-bd13-bacafdb80945 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:17.962452 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:17.963099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:17.963381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:17.963654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:17.964371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:17.966244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:18.211326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1157/2330] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:17 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:18.215144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:18.226334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdb23de6b494ffdbfee7b902eef0172', 'request_id': 'req-769d6e49-89e5-4f5d-a091-6fd05c332e1c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.284486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07122c0-594f-4c59-befe-fc7452581e37 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:18.285730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdb23de6b494ffdbfee7b902eef0172', 'request_id': 'req-769d6e49-89e5-4f5d-a091-6fd05c332e1c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.296271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdb23de6b494ffdbfee7b902eef0172', 'request_id': 'req-769d6e49-89e5-4f5d-a091-6fd05c332e1c'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.319675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:18.319675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:18.319675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:18.319675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:18.320144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:18.320377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:18.321268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] The token cache is being invalidate because project 6bdb23de6b494ffdbfee7b902eef0172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:18.321268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.343605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.350884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1174/2331] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:17 2022] DELETE /identity/v3/projects/6bdb23de6b494ffdbfee7b902eef0172 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:18.355670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:18.365186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:18.433273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1158/2332] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:18 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:49:18.443556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:18.452111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:18.462226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6e49-89e5-4f5d-a091-6fd05c332e1c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:18.475817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:18.478529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:18.478818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:18.479096 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] PATH_INFO: `/v3/users/37226d4db80143c486fe14a429cf29f3` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:18.481225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37226d4db80143c486fe14a429cf29f3)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:18.484332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:18.523563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe833e-e99b-48a4-b614-dcabdee0277f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:18.540492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:18.550530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:18.550530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:18.550530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:18.550530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:18.550530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:18.563163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1159/2333] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:18.567148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:18.579182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa0a60-e1ee-4028-b383-298b18e0fbba admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:18.585210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:18.586041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:18.586328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:18.586609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:18.587568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:18.589227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:18.604184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1160/2334] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:18.607764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:18.621472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570708b8-54cf-4df8-b445-623ec6ef5466 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:18.626886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d75bc-5c3a-437b-9af7-b7582569e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:18.627806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d75bc-5c3a-437b-9af7-b7582569e35c admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:18.628106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d75bc-5c3a-437b-9af7-b7582569e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:18.628381 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d75bc-5c3a-437b-9af7-b7582569e35c admin admin] PATH_INFO: `/v3/projects/3c58655a759549929290cd055fc07d56/users/e7ec68df79de454698edba9e2401b3f0/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:18.655816 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d75bc-5c3a-437b-9af7-b7582569e35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c58655a759549929290cd055fc07d56, user_id=e7ec68df79de454698edba9e2401b3f0, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:18.659570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d75bc-5c3a-437b-9af7-b7582569e35c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:18.763884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37226d4db80143c486fe14a429cf29f3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.765320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37226d4db80143c486fe14a429cf29f3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.821533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1161/2335] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:18 2022] PUT /identity/v3/projects/3c58655a759549929290cd055fc07d56/users/e7ec68df79de454698edba9e2401b3f0/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:18.832808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:18.833389 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:18.833821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:18.868012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] MFA Rules not processed for user `e7ec68df79de454698edba9e2401b3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:18.869732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:18.882030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37226d4db80143c486fe14a429cf29f3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.883389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37226d4db80143c486fe14a429cf29f3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.895590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37226d4db80143c486fe14a429cf29f3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:18.909777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:18.928103 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:18.930256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1175/2336] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:18 2022] DELETE /identity/v3/users/37226d4db80143c486fe14a429cf29f3 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:18.972633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1162/2337] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:18.985043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:18.987830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:19.098527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be6ff-3214-46fb-9a2d-a1bbb667209f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:19.103792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:19.104972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:19.105624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:19.106100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:19.181171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:19.183077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:19.195203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1176/2338] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:19.228446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:19.229884 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:19.390183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765578f-0c3b-4299-bb03-4d2267bc205b None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:19.541011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:19.542838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:19.545659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:19.546063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] PATH_INFO: `/v3/users/e7ec68df79de454698edba9e2401b3f0` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:19.547458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ec68df79de454698edba9e2401b3f0)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:19.550773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:19.837524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ec68df79de454698edba9e2401b3f0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:19.881536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:19.882076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:19.905300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a716-2d71-44c5-b9ac-e45066470f4b service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:19.918466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:19.919354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:19.919641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:19.919919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] PATH_INFO: `/v3/projects/1048fd63a1c044ccb01a62f860d59c4e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:19.926094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1048fd63a1c044ccb01a62f860d59c4e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:19.928089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:19.936818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ec68df79de454698edba9e2401b3f0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:19.939787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ec68df79de454698edba9e2401b3f0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:19.941763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ec68df79de454698edba9e2401b3f0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:19.960801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-799820d1-c098-4cc7-971f-e614a649ae11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ec68df79de454698edba9e2401b3f0'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:20.013409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1163/2339] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:19 2022] DELETE /identity/v3/users/e7ec68df79de454698edba9e2401b3f0 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:20.019805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.020551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.021129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.028224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:20.066040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:20.068022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:20.140737 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1048fd63a1c044ccb01a62f860d59c4e', 'request_id': 'req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:20.264692 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1164/2340] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:20.267355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1048fd63a1c044ccb01a62f860d59c4e', 'request_id': 'req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:20.279191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:20.281914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:20.283899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1048fd63a1c044ccb01a62f860d59c4e', 'request_id': 'req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:20.307189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] The token cache is being invalidate because project 1048fd63a1c044ccb01a62f860d59c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:20.307506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:20.308280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4574d8f4-ca00-4ccd-9b8e-eac0d3fd0926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:20.309927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1177/2341] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:19 2022] DELETE /identity/v3/projects/1048fd63a1c044ccb01a62f860d59c4e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:49:20.316982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2283f5-58f8-44ef-a75c-cbab6545b43f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.317299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2283f5-58f8-44ef-a75c-cbab6545b43f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.322426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2283f5-58f8-44ef-a75c-cbab6545b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.343254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:20.354081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-bb2283f5-58f8-44ef-a75c-cbab6545b43f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:20.355323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bb2283f5-58f8-44ef-a75c-cbab6545b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:20.430161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf893c-15c4-4922-a5ce-0f5c855bcf55 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:20.470797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1178/2342] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:20.473504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.473777 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.474952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.507126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:20.509387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:20.523462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1179/2343] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:20.528830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:20.528830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.528830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.528830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.530397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:20.531195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:20.548526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478efd-b145-49eb-938c-0a3082c52b46 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:20.549617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:20.551956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:20.562748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:20.564265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.565159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.565457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.566374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:49:20.566668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:20.578926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1165/2344] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:20.579405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:20.594990 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1180/2345] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:49:20.600198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:20.621912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933c5a7-a9b2-4467-ba44-0dedf6802c6a service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:20.635494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:20.636312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.636695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.637336 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.638312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:20.640792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:20.774377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1166/2346] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:20 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:20.778784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:20.789869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a342-323b-437a-b2ed-127e6c97f1b3 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:20.852466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:20.853079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:20.853724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:20.853724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:20.854407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:20.857790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:20.971810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1181/2347] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:20 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:20.976032 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:20.993622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef193-b171-4b7f-b06a-89af6fad3170 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.009922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.010620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.010906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.011184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.018362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.020169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.036483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1167/2348] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:21.040527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.053274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b187-f533-45ad-99c9-374224510a8c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.058711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828010f-b276-471e-9370-9039355d469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.059567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828010f-b276-471e-9370-9039355d469e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.059929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828010f-b276-471e-9370-9039355d469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.060352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828010f-b276-471e-9370-9039355d469e admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.061143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828010f-b276-471e-9370-9039355d469e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.062881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828010f-b276-471e-9370-9039355d469e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.079673 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1182/2349] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:21.085147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.104534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df809-238a-4084-ae38-2f7fa92f2b5e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.114438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd98b70-1a3c-4568-9a28-deb29f6bf6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.116225 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98b70-1a3c-4568-9a28-deb29f6bf6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.117468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98b70-1a3c-4568-9a28-deb29f6bf6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.117890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98b70-1a3c-4568-9a28-deb29f6bf6a5 admin admin] PATH_INFO: `/v3/projects/45ae6ae6ff91467499b14ced53d72090/users/018f9ecf4298401cb5da93dfbf5d0cfe/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.129632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828010f-b276-471e-9370-9039355d469e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.133628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e828010f-b276-471e-9370-9039355d469e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:21.141834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98b70-1a3c-4568-9a28-deb29f6bf6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ae6ae6ff91467499b14ced53d72090, user_id=018f9ecf4298401cb5da93dfbf5d0cfe, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.145815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98b70-1a3c-4568-9a28-deb29f6bf6a5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.161850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828010f-b276-471e-9370-9039355d469e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.167965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.169192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.169518 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.170262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] PATH_INFO: `/v3/projects/3c58655a759549929290cd055fc07d56` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.179784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c58655a759549929290cd055fc07d56)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.182624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.236137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1168/2350] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:21 2022] PUT /identity/v3/projects/45ae6ae6ff91467499b14ced53d72090/users/018f9ecf4298401cb5da93dfbf5d0cfe/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:49:21.247392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.247744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.248118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.255862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:21.283702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] MFA Rules not processed for user `018f9ecf4298401cb5da93dfbf5d0cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:21.285215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:21.344940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c58655a759549929290cd055fc07d56', 'request_id': 'req-c6a44b74-57f6-4a8c-8b18-8820f422268a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:21.370691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1169/2351] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:21.382650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.385406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:21.411238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c58655a759549929290cd055fc07d56', 'request_id': 'req-c6a44b74-57f6-4a8c-8b18-8820f422268a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:21.418249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:21.420607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c58655a759549929290cd055fc07d56', 'request_id': 'req-c6a44b74-57f6-4a8c-8b18-8820f422268a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:21.437923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] The token cache is being invalidate because project 3c58655a759549929290cd055fc07d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:21.438333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:21.440371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c6a44b74-57f6-4a8c-8b18-8820f422268a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:21.445415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1183/2352] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:21 2022] DELETE /identity/v3/projects/3c58655a759549929290cd055fc07d56 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:49:21.447552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290c0a-4ae1-4422-b9e4-a98285b981b4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.447957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290c0a-4ae1-4422-b9e4-a98285b981b4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.448316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290c0a-4ae1-4422-b9e4-a98285b981b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.478490 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4e290c0a-4ae1-4422-b9e4-a98285b981b4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:21.479863 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4e290c0a-4ae1-4422-b9e4-a98285b981b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:21.497614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2f395-5e52-4212-8751-987967aa75bd None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.572231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1184/2353] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:21.581414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.581712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.581994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.587946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.588834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.589266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.589550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.593659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:21.604799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:21.606064 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:21.620588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1185/2354] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:21.622610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.636775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afbf1d-ed43-48cf-b716-827fe9944edc None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.642910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.643765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.644076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.644371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.645104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:49:21.645411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.647041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.665583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1186/2355] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:49:21.665907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.666341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.667557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.679280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1170/2356] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:21.684336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2926-00ca-4d94-a854-6dfb7f38b052 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.690315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.690987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.691279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.691561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.692310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.694240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:21.809727 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1187/2357] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:21 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:21.813783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:21.825875 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:21.837283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c251a6-f4af-432f-894c-d46d4dbf103f service glance] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:21.918598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:21.919701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:21.920251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:21.920897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:21.921823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:21.924458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:22.041014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1171/2358] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:21 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:22.041993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:22.052805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a239-4e34-4e22-9d19-936a58c55575 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:22.057461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:22.058141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:22.058423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:22.058696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:22.059416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:22.061055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:22.073799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1188/2359] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:22.076567 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:22.088136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de306f30-c3dd-41f0-b6ba-d57f8f47fd27 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:22.101070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dda90-4d89-4bdb-a334-8d46af0168ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:22.101758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dda90-4d89-4bdb-a334-8d46af0168ac admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:22.102050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dda90-4d89-4bdb-a334-8d46af0168ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:22.102315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dda90-4d89-4bdb-a334-8d46af0168ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:22.103081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dda90-4d89-4bdb-a334-8d46af0168ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:22.104717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dda90-4d89-4bdb-a334-8d46af0168ac admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:22.116897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1172/2360] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:22.121053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:22.132233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb3019-bdc7-4d9f-b51f-c5f616345916 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:22.139516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:22.140845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:22.141296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:22.142247 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] PATH_INFO: `/v3/projects/4ea38e4cb18445af9b86826fe2a998b3/users/1e6bc67b1f154df3bef25192c4a60392/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:22.166341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea38e4cb18445af9b86826fe2a998b3, user_id=1e6bc67b1f154df3bef25192c4a60392, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:22.169132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:22.272143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1189/2361] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:22 2022] PUT /identity/v3/projects/4ea38e4cb18445af9b86826fe2a998b3/users/1e6bc67b1f154df3bef25192c4a60392/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:22.283182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c54e-87ae-4bc7-b396-82a98d9824c5 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:22.283633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c54e-87ae-4bc7-b396-82a98d9824c5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:22.283925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c54e-87ae-4bc7-b396-82a98d9824c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:22.328229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3e30c54e-87ae-4bc7-b396-82a98d9824c5 None None] MFA Rules not processed for user `1e6bc67b1f154df3bef25192c4a60392`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:22.329565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3e30c54e-87ae-4bc7-b396-82a98d9824c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:22.430257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1173/2362] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:22.444156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:22.444393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:22.504019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13e777-c997-4252-9070-0186797ace4e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:22.519795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba684-3c38-4120-8391-b4f25ff0d8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:22.519795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba684-3c38-4120-8391-b4f25ff0d8ab service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:22.519795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba684-3c38-4120-8391-b4f25ff0d8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:22.519795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba684-3c38-4120-8391-b4f25ff0d8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:22.520245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba684-3c38-4120-8391-b4f25ff0d8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:22.520458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba684-3c38-4120-8391-b4f25ff0d8ab service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:22.529875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1190/2363] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:32.427030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:32.525339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:DELETE=1,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:36.987424 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef20c7-ddcc-4a53-bcb2-445ee508d7e9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:36.988031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef20c7-ddcc-4a53-bcb2-445ee508d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:36.988031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef20c7-ddcc-4a53-bcb2-445ee508d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:37.012598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-23ef20c7-ddcc-4a53-bcb2-445ee508d7e9 None None] MFA Rules not processed for user `28d78d4ead234cc68e377c8b5b6e4d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:37.013904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-23ef20c7-ddcc-4a53-bcb2-445ee508d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:37.083276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1174/2364] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:38.870666 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e134e4-7ade-4951-930f-c345babc8b33 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:38.871156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e134e4-7ade-4951-930f-c345babc8b33 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:38.871239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e134e4-7ade-4951-930f-c345babc8b33 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:38.872622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1191/2365] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:49:38.879292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff537f2-179b-4bad-ab46-d4841742bfaa None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:38.879823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff537f2-179b-4bad-ab46-d4841742bfaa None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:38.879941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff537f2-179b-4bad-ab46-d4841742bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:38.944557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-aff537f2-179b-4bad-ab46-d4841742bfaa None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:38.946056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-aff537f2-179b-4bad-ab46-d4841742bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:39.038191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1175/2366] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:39.050613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e134e4-7ade-4951-930f-c345babc8b33 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:39.052393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b4e134e4-7ade-4951-930f-c345babc8b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:39.134314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e134e4-7ade-4951-930f-c345babc8b33 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:39.141817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fec5a-b8e1-47e7-9843-b17f40c78127 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:39.143193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fec5a-b8e1-47e7-9843-b17f40c78127 service glance] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.143193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fec5a-b8e1-47e7-9843-b17f40c78127 service glance] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.143193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fec5a-b8e1-47e7-9843-b17f40c78127 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.154867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fec5a-b8e1-47e7-9843-b17f40c78127 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:39.156912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fec5a-b8e1-47e7-9843-b17f40c78127 service glance] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:39.171227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1192/2367] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:39.444599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f30dba-4912-4f54-800e-260015215c49 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.444835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f30dba-4912-4f54-800e-260015215c49 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.445078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f30dba-4912-4f54-800e-260015215c49 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.446468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1176/2368] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:49:39.451358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f30e-4028-48ee-9647-d07c7cf971f5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.451671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f30e-4028-48ee-9647-d07c7cf971f5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.451952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f30e-4028-48ee-9647-d07c7cf971f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.470444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-b016f30e-4028-48ee-9647-d07c7cf971f5 None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:39.471905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b016f30e-4028-48ee-9647-d07c7cf971f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:39.524829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1193/2369] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:39.536463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f30dba-4912-4f54-800e-260015215c49 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:39.538176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f3f30dba-4912-4f54-800e-260015215c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:39.551852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f30dba-4912-4f54-800e-260015215c49 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:39.555277 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808447e-2897-43cd-8016-454025df85ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:39.555934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808447e-2897-43cd-8016-454025df85ae service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.556241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808447e-2897-43cd-8016-454025df85ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.556515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808447e-2897-43cd-8016-454025df85ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.564236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808447e-2897-43cd-8016-454025df85ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:39.565672 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808447e-2897-43cd-8016-454025df85ae service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:39.573449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1177/2370] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:39.663175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169b49-911a-4932-94b5-cbb657b6f01d None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.663469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169b49-911a-4932-94b5-cbb657b6f01d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.663751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169b49-911a-4932-94b5-cbb657b6f01d None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.665175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1194/2371] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:49:39.672038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.672869 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.673120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.691811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:39.693118 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:39.702774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1178/2372] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:39.713782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169b49-911a-4932-94b5-cbb657b6f01d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:39.725742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169b49-911a-4932-94b5-cbb657b6f01d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:39.729267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2064be1-404d-4b1e-b868-672219b56d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:39.729901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064be1-404d-4b1e-b868-672219b56d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:39.730178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064be1-404d-4b1e-b868-672219b56d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:39.730446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064be1-404d-4b1e-b868-672219b56d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:39.741371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2064be1-404d-4b1e-b868-672219b56d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:39.743670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2064be1-404d-4b1e-b868-672219b56d07 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:39.753857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1195/2373] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:40.213728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:40.264640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:40.284009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae171523-5102-4544-ab12-b14a5bdaf6f0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:40.288888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:40.289778 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:40.290063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:40.290343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] PATH_INFO: `/v3/users/1e6bc67b1f154df3bef25192c4a60392` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:40.291649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6bc67b1f154df3bef25192c4a60392)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:40.293623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:40.490943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6bc67b1f154df3bef25192c4a60392'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:40.573838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6bc67b1f154df3bef25192c4a60392'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:40.575028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6bc67b1f154df3bef25192c4a60392'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:40.575670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6bc67b1f154df3bef25192c4a60392'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:40.584547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6bc67b1f154df3bef25192c4a60392'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:40.604358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1179/2374] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:40 2022] DELETE /identity/v3/users/1e6bc67b1f154df3bef25192c4a60392 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:40.608784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:40.614079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:40.614079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:40.628578 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:40.629793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:40.696146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1196/2375] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:40.707055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:40.708477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:40.769016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e63b7-00f3-4aa4-9a1c-4a920d21ec04 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:40.772645 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb049438-f988-4d17-8137-e2a07e52cb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:40.773289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb049438-f988-4d17-8137-e2a07e52cb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:40.773572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb049438-f988-4d17-8137-e2a07e52cb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:40.773864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb049438-f988-4d17-8137-e2a07e52cb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:40.783974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb049438-f988-4d17-8137-e2a07e52cb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:40.785902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb049438-f988-4d17-8137-e2a07e52cb47 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:40.798285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1180/2376] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:41.488494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:41.490237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:41.502934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da03d1-0288-4a52-a6c3-24acf6f2f619 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:41.511527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:41.513465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:41.513762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:41.514038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] PATH_INFO: `/v3/projects/4ea38e4cb18445af9b86826fe2a998b3` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:41.519668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea38e4cb18445af9b86826fe2a998b3)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:41.521653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:41.539609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:41.690552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea38e4cb18445af9b86826fe2a998b3', 'request_id': 'req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:41.787615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea38e4cb18445af9b86826fe2a998b3', 'request_id': 'req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:41.798680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea38e4cb18445af9b86826fe2a998b3', 'request_id': 'req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:41.814145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] The token cache is being invalidate because project 4ea38e4cb18445af9b86826fe2a998b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:41.814594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:41.815354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3f7ed61a-67a5-45e2-a8dd-f2afe1f1bf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:41.817637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1197/2377] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:41 2022] DELETE /identity/v3/projects/4ea38e4cb18445af9b86826fe2a998b3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:41.822579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:41.823077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:41.823183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:41.841087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:41.842293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:41.903196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1181/2378] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:41.911876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:41.912199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:41.912481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:41.931036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:41.932215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:41.941390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1198/2379] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:41.945755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:41.956243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e44e3-1246-4fb5-b89b-93a7a2567a8a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:41.960947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:41.961617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:41.961903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:41.962182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:41.962913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:49:41.963614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:41.964871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:41.966676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:41.977594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1182/2380] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:49:41.981980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:41.995849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a92b0-d9c0-428d-8397-6c3e6a58d65f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.001762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.002442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.002756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.003269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.003937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.005931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.040788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:42.042474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:42.143428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361cf4-a6ca-41a6-b607-f2dcabbbf3db admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.177843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1199/2381] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:41 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:42.178829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:42.220182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.220860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.221124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.221655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.223451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:42.235610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.237254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.247455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1183/2382] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:42.261960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9245-e7df-4fb0-9809-c0d881fc1f4c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.267811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.268524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.268811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.269090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.269782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.271757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.354585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1200/2383] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:42 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:42.361530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:42.371466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d568-9bd4-466f-a4fe-44d714fbd36c service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.378625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.379310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.379594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.379873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.380913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.382561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.394031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1184/2384] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:42.398153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:42.408396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5da373-27ef-487e-b82e-2341f9bc53e0 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.416570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4d7e5-a0f3-47e4-a96b-38d29a6ba17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.417663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4d7e5-a0f3-47e4-a96b-38d29a6ba17b admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.417663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4d7e5-a0f3-47e4-a96b-38d29a6ba17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.417900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4d7e5-a0f3-47e4-a96b-38d29a6ba17b admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.418642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4d7e5-a0f3-47e4-a96b-38d29a6ba17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.420528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4d7e5-a0f3-47e4-a96b-38d29a6ba17b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.435102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1201/2385] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:42.442028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:42.455915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479844b-2933-4b95-a441-4c324f65eec2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.463833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.465028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.465468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.465902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] PATH_INFO: `/v3/projects/14385fc22a1d4de4bc0af0c764f6ef69/users/d6bd0d1fd6be41a3a711be3fb4c0cbfc/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.506195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] RBAC: Authorizing `identity:create_grant(project_id=14385fc22a1d4de4bc0af0c764f6ef69, user_id=d6bd0d1fd6be41a3a711be3fb4c0cbfc, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.509562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.620772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1185/2386] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:42 2022] PUT /identity/v3/projects/14385fc22a1d4de4bc0af0c764f6ef69/users/d6bd0d1fd6be41a3a711be3fb4c0cbfc/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:49:42.626154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.626506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.626931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.649465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:42.650940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:42.726245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:42.741797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1202/2387] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:42.761878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:42.763607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:42.823854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b48d-d454-4dfb-8239-dd1bf1ee52af admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:42.830549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c4f6b-6c44-4e4e-884f-e12e99357f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:42.831316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c4f6b-6c44-4e4e-884f-e12e99357f76 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:42.831601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c4f6b-6c44-4e4e-884f-e12e99357f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:42.831986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c4f6b-6c44-4e4e-884f-e12e99357f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:42.844727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c4f6b-6c44-4e4e-884f-e12e99357f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:42.846574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c4f6b-6c44-4e4e-884f-e12e99357f76 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:42.864822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1186/2388] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:42.922723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:45.022695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:45.025641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:45.042257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa0ce5-984a-4ec3-9f09-71cc46f56902 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:45.049326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:45.050390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:45.050889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:45.057548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] PATH_INFO: `/v3/users/018f9ecf4298401cb5da93dfbf5d0cfe` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:45.057548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018f9ecf4298401cb5da93dfbf5d0cfe)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:45.057548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:45.288246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018f9ecf4298401cb5da93dfbf5d0cfe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:45.292036 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018f9ecf4298401cb5da93dfbf5d0cfe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:45.370159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018f9ecf4298401cb5da93dfbf5d0cfe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:45.370924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018f9ecf4298401cb5da93dfbf5d0cfe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:45.379912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ebd49576-e274-4442-92d7-57ddca97c137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018f9ecf4298401cb5da93dfbf5d0cfe'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:45.405954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1203/2389] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:49:45 2022] DELETE /identity/v3/users/018f9ecf4298401cb5da93dfbf5d0cfe => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:45.411330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:45.411765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:45.411765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:45.448180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:45.449481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:45.501105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:45.501618 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:45.502048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:45.561916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1187/2390] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:45.574569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:45.581331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:45.588390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:45.589594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:45.680894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0874f7-3c9d-43b0-a431-c23e6f504c84 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:45.689145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:45.689818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:45.690093 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:45.690369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:45.699729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1204/2391] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:49:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:49:45.707498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:45.708952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:45.713034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:45.714605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:45.719753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1188/2392] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:45.794279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:45.879593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc33f4-39b2-4986-9c0e-80d504fd8977 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:45.888609 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58476707-ea95-498d-b46d-b931f7daddcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:45.889850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476707-ea95-498d-b46d-b931f7daddcd service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:45.890193 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476707-ea95-498d-b46d-b931f7daddcd service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:45.890554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476707-ea95-498d-b46d-b931f7daddcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:45.899846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58476707-ea95-498d-b46d-b931f7daddcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:45.901558 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58476707-ea95-498d-b46d-b931f7daddcd service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:45.912462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1205/2393] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 13:49:46.229640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:46.231214 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:46.268312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2c9a-d397-49e3-b712-3353c6f819b5 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:46.275837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:46.277111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:46.284835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:46.285703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] PATH_INFO: `/v3/projects/45ae6ae6ff91467499b14ced53d72090` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:46.287927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ae6ae6ff91467499b14ced53d72090)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:46.291677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:46.500982 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ae6ae6ff91467499b14ced53d72090', 'request_id': 'req-da467e97-a9a6-42c3-9d05-2090ec8d61e2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:46.520677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ae6ae6ff91467499b14ced53d72090', 'request_id': 'req-da467e97-a9a6-42c3-9d05-2090ec8d61e2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:46.647421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ae6ae6ff91467499b14ced53d72090', 'request_id': 'req-da467e97-a9a6-42c3-9d05-2090ec8d61e2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:46.658484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:46.665459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] The token cache is being invalidate because project 45ae6ae6ff91467499b14ced53d72090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:49:46.666009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:46.672458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-da467e97-a9a6-42c3-9d05-2090ec8d61e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:49:46.674635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1189/2394] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:49:46 2022] DELETE /identity/v3/projects/45ae6ae6ff91467499b14ced53d72090 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:46.679991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:46.680526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:46.680838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:46.708689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:46.710377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:46.848762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1206/2395] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:46.856318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:46.857012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:46.857497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:46.899016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:46.902767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:46.918297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:46.932232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1190/2396] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:46.944362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15395b6e-d871-476a-8073-f4971eacaad3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:46.949847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:46.950637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:46.950969 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:46.951341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:46.952415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:49:46.952900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:46.954790 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:46.969101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1207/2397] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:49:46.973481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:46.985402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7e114-bb68-4c27-8dc2-c495ef8536c4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:46.995467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:46.996222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:47.002341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:47.002341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:47.002341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:47.002341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:47.084853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1191/2398] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:46 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:47.086037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:47.108351 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab47f7c-95ad-4929-a663-7d32ef897973 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:47.210669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:47.211944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:47.212466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:47.212939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:47.213854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:47.216243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:47.370714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1208/2399] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:47 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:49:47.370954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:47.381420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09c5d2-d99e-427d-97eb-b1b287a14518 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:47.389426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:47.390286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:47.391454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:47.391895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:47.393164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:47.395764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:47.426829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:47.439045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1192/2400] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:49:47.444406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769981d-e248-4f98-a68f-7a24e71783ee admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:47.458665 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f47691-772a-4444-87d7-7ad15c868a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:47.459379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f47691-772a-4444-87d7-7ad15c868a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:47.459765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f47691-772a-4444-87d7-7ad15c868a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:47.460265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f47691-772a-4444-87d7-7ad15c868a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:47.461065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f47691-772a-4444-87d7-7ad15c868a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:47.462853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f47691-772a-4444-87d7-7ad15c868a0e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:47.490530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1209/2401] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:47.492638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:47.519013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d9d4-c114-4814-ac42-4a3004c1c7f7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:47.560078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:47.560078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:47.560078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:47.560078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] PATH_INFO: `/v3/projects/b08db5688d3442f3b8c9e39abc50be51/users/f3350ad030c44b08b61c334b9b85ce65/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:47.580086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08db5688d3442f3b8c9e39abc50be51, user_id=f3350ad030c44b08b61c334b9b85ce65, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:47.582834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:47.717573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1193/2402] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:47 2022] PUT /identity/v3/projects/b08db5688d3442f3b8c9e39abc50be51/users/f3350ad030c44b08b61c334b9b85ce65/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:47.801783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59389f4-3a58-48e0-8189-a8053b9b019a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:47.802686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59389f4-3a58-48e0-8189-a8053b9b019a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:47.803339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59389f4-3a58-48e0-8189-a8053b9b019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:47.872286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:47.884198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c59389f4-3a58-48e0-8189-a8053b9b019a None None] MFA Rules not processed for user `f3350ad030c44b08b61c334b9b85ce65`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:47.892679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c59389f4-3a58-48e0-8189-a8053b9b019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:48.118128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1210/2403] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:48.135031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:48.137101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:48.215990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f938c-031f-494b-9248-4c3ecd8d44b5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:48.220714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:48.223481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:48.228446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:48.228929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:48.255141 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:48.259346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:48.305666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1194/2404] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:49:51.327481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:51.329284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:51.329634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:51.388217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] MFA Rules not processed for user `d6bd0d1fd6be41a3a711be3fb4c0cbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:51.389921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:51.559282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:51.564537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:51.568462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1211/2405] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:51.765951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41e3b8-235a-48c7-b127-b2f80c9c4077 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:51.789522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:51.790209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:51.790487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:51.790825 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:51.791809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:51.795697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:51.928483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1195/2406] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:49:51 2022] POST /identity/v3/projects => generated 385 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:49:51.934210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:51.958206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88299e6-1573-495e-a190-2cb362e7a5e8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:52.034421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:52.035276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:52.035670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:52.035977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:52.037022 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:52.039158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:52.138877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1212/2407] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:49:51 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:49:52.140870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:52.153320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f4ee5-17da-4884-a2da-5cf11d309d53 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:52.159518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:52.160744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:52.161617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:52.161931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:52.162838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:52.164505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:52.179675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1196/2408] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:49:52.181123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:52.192910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6be0-7386-4993-8beb-c24d0daebf7d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:52.202215 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:52.204236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:52.204783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:52.205289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] PATH_INFO: `/v3/projects/d577681733474beb8e17acfa66ccba7e/users/663f2377a76f4d608a1b37b3794453e5/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:52.233100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d577681733474beb8e17acfa66ccba7e, user_id=663f2377a76f4d608a1b37b3794453e5, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:52.237806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:52.303521 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:52.309031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1213/2409] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:52 2022] PUT /identity/v3/projects/d577681733474beb8e17acfa66ccba7e/users/663f2377a76f4d608a1b37b3794453e5/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:52.313795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:52.324725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad943-7470-4491-8c8e-9b2cb8134151 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:52.334297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:52.405425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407efb3a-3339-4561-92e5-40aaea8f26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:52.406940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407efb3a-3339-4561-92e5-40aaea8f26e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:52.407445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407efb3a-3339-4561-92e5-40aaea8f26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:52.407944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407efb3a-3339-4561-92e5-40aaea8f26e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:52.409022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407efb3a-3339-4561-92e5-40aaea8f26e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:52.410856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407efb3a-3339-4561-92e5-40aaea8f26e9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:52.434869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:52.437303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1197/2410] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:49:52.447533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e67ad-4ba5-4a46-ac11-c0eb42452899 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:49:52.462562 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:49:52.463844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:52.464236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:52.471603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] PATH_INFO: `/v3/projects/d577681733474beb8e17acfa66ccba7e/users/663f2377a76f4d608a1b37b3794453e5/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:52.471603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d577681733474beb8e17acfa66ccba7e, user_id=663f2377a76f4d608a1b37b3794453e5, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:49:52.471603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:49:52.494320 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1214/2411] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:49:52 2022] PUT /identity/v3/projects/d577681733474beb8e17acfa66ccba7e/users/663f2377a76f4d608a1b37b3794453e5/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:49:59.846804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9611-7516-4774-b9c3-0d05e7a7ecf1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:49:59.847378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9611-7516-4774-b9c3-0d05e7a7ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:49:59.847378 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9611-7516-4774-b9c3-0d05e7a7ecf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:49:59.874800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-abde9611-7516-4774-b9c3-0d05e7a7ecf1 None None] MFA Rules not processed for user `663f2377a76f4d608a1b37b3794453e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:49:59.876272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-abde9611-7516-4774-b9c3-0d05e7a7ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:49:59.950267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1198/2412] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:49:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:49:59.962462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:49:59.964288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:00.025639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d454a5-cd3c-4f25-9dfc-81b7145e8788 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:00.029581 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:00.030778 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:00.031063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:00.031340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:00.102870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:00.104519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:00.116132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1215/2413] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:49:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:50:00.431319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c2a9-5424-4f3e-88c4-c74a70b7fbc8 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:00.431610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c2a9-5424-4f3e-88c4-c74a70b7fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:00.431890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7c2a9-5424-4f3e-88c4-c74a70b7fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:00.453970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-51b7c2a9-5424-4f3e-88c4-c74a70b7fbc8 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:50:00.453970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-51b7c2a9-5424-4f3e-88c4-c74a70b7fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:00.510084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1199/2414] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:50:00.523314 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:00.524748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:00.610868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad58b0-dcb8-42f5-b717-086de25302f5 service glance] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:00.616310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:00.616982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:00.617268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:00.617563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:00.632416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:00.634378 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:00.645837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1216/2415] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:50:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:50:10.537590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=82 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:10.555090 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90c64-1406-4c02-aa59-a8dc912d2127 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:10.555406 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90c64-1406-4c02-aa59-a8dc912d2127 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:10.555691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90c64-1406-4c02-aa59-a8dc912d2127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:10.582798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-bda90c64-1406-4c02-aa59-a8dc912d2127 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:50:10.584209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bda90c64-1406-4c02-aa59-a8dc912d2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:10.593001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1200/2416] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 8 13:50:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:50:10.609629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:10.621913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6bc41-0ece-419f-949d-19d796a15059 service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:10.628000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:10.628891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:10.629248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:10.629623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:10.645924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:10.647930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:10.660804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1217/2417] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:50:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 13:50:12.864493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46701db-1053-4eda-b52a-b13e55cd9056 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:12.865027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46701db-1053-4eda-b52a-b13e55cd9056 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:12.865123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46701db-1053-4eda-b52a-b13e55cd9056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:12.883081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b46701db-1053-4eda-b52a-b13e55cd9056 None None] MFA Rules not processed for user `d6bd0d1fd6be41a3a711be3fb4c0cbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:50:12.884305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b46701db-1053-4eda-b52a-b13e55cd9056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:12.891935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1201/2418] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:50:12.949554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:12.968613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:13.017283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b9c4-c3e9-4bd4-a1ff-fd61a0620df3 service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:13.022500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:13.023371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:13.023789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:13.024006 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] PATH_INFO: `/v3/users/f3350ad030c44b08b61c334b9b85ce65` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:13.025145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3350ad030c44b08b61c334b9b85ce65)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:13.027092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:13.280635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3350ad030c44b08b61c334b9b85ce65'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:13.281425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3350ad030c44b08b61c334b9b85ce65'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:13.407145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3350ad030c44b08b61c334b9b85ce65'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:13.407829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3350ad030c44b08b61c334b9b85ce65'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:13.415481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3350ad030c44b08b61c334b9b85ce65'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:13.437959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1218/2419] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:50:12 2022] DELETE /identity/v3/users/f3350ad030c44b08b61c334b9b85ce65 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:50:13.439364 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:13.440008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:13.440008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:13.459623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:50:13.460883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:13.533961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1202/2420] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:50:13.543642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:13.545245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:13.606171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff9a0-43a7-4392-b44f-e6150dab6e79 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:13.610820 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2d20d-2d82-491d-aee1-6f65d4b81ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:13.611414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d20d-2d82-491d-aee1-6f65d4b81ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:13.611694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d20d-2d82-491d-aee1-6f65d4b81ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:13.612073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d20d-2d82-491d-aee1-6f65d4b81ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:13.622032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2d20d-2d82-491d-aee1-6f65d4b81ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:13.623980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2d20d-2d82-491d-aee1-6f65d4b81ca4 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:13.636428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1219/2421] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:50:14.155439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:14.157663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:14.178570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca4b9-a778-432c-8edd-f4047ffac35a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:14.189720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:14.190741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:14.191264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:14.191605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] PATH_INFO: `/v3/projects/b08db5688d3442f3b8c9e39abc50be51` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:14.193363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08db5688d3442f3b8c9e39abc50be51)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:14.197236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:14.340895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08db5688d3442f3b8c9e39abc50be51', 'request_id': 'req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:14.348176 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08db5688d3442f3b8c9e39abc50be51', 'request_id': 'req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:14.432119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08db5688d3442f3b8c9e39abc50be51', 'request_id': 'req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:14.443950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] The token cache is being invalidate because project b08db5688d3442f3b8c9e39abc50be51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:50:14.444270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:14.444895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:50:14.446429 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1203/2422] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:50:14 2022] DELETE /identity/v3/projects/b08db5688d3442f3b8c9e39abc50be51 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:50:17.312985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef52a3-7b69-4a12-8734-64b8e4d61a41 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:17.313495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef52a3-7b69-4a12-8734-64b8e4d61a41 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:17.313605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef52a3-7b69-4a12-8734-64b8e4d61a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:17.332188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-52ef52a3-7b69-4a12-8734-64b8e4d61a41 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:50:17.333418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-52ef52a3-7b69-4a12-8734-64b8e4d61a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:17.367491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:17.391044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1220/2423] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:50:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:50:17.412192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:17.413641 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:17.485340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b90e5e-c01f-4300-98eb-9cbd243bfe1e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:17.490964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:17.491632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:17.491920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:17.492245 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:17.502205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:17.503936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:17.511503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:17.515604 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1204/2424] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:50:28.049373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=8 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:31.000403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb200-8d6f-41bd-984a-932b5a25a65e None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:31.001112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb200-8d6f-41bd-984a-932b5a25a65e None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:31.001112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb200-8d6f-41bd-984a-932b5a25a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:31.019171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fbffb200-8d6f-41bd-984a-932b5a25a65e None None] MFA Rules not processed for user `85e0d647620a407cbe03d83c86111f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:50:31.020407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fbffb200-8d6f-41bd-984a-932b5a25a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:31.075078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1221/2425] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:50:41.068504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=25 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:57.289250 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:50:57.291133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:57.349724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c19d5-3395-4133-9754-2e3d1b15224b service swift] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:50:57.353340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:50:57.353984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:50:57.354264 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:50:57.354536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:50:57.356397 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:50:57.420748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:50:57.422096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:50:57.432332 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1205/2426] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:50:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:07.427947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=50 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:09.384966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:09.385527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:09.385527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:09.403564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] MFA Rules not processed for user `1b970b89c20645d98da510e03a915fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:09.404985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:09.461257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1222/2427] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:17.003234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:17.004799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:17.079528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067a15-2910-4895-a728-487b29ede043 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:17.085241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:17.090522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:17.090522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:17.090522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] PATH_INFO: `/v3/users/28d78d4ead234cc68e377c8b5b6e4d5a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:17.090522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d78d4ead234cc68e377c8b5b6e4d5a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:17.090522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:17.289446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d78d4ead234cc68e377c8b5b6e4d5a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.366832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d78d4ead234cc68e377c8b5b6e4d5a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.367439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d78d4ead234cc68e377c8b5b6e4d5a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.368031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d78d4ead234cc68e377c8b5b6e4d5a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.375341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c4ba957-26bd-4732-b3cd-cdf83216dbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d78d4ead234cc68e377c8b5b6e4d5a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.393575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1206/2428] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:51:17 2022] DELETE /identity/v3/users/28d78d4ead234cc68e377c8b5b6e4d5a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:17.620152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:17.631740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cf98-5aad-4966-9545-9191005ee0e7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:17.690928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:17.691852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:17.692170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:17.692453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] PATH_INFO: `/v3/projects/1b38f30ffdc74b66aa2a5ed7d7eb1e0d` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:17.693764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b38f30ffdc74b66aa2a5ed7d7eb1e0d)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:17.695695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:17.832585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'request_id': 'req-d46cfcce-672f-42ac-835a-4709d8297504'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.896354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'request_id': 'req-d46cfcce-672f-42ac-835a-4709d8297504'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.906815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'request_id': 'req-d46cfcce-672f-42ac-835a-4709d8297504'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.914142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] The token cache is being invalidate because project 1b38f30ffdc74b66aa2a5ed7d7eb1e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:51:17.914434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.915079 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d46cfcce-672f-42ac-835a-4709d8297504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:17.917139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1223/2429] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:51:17 2022] DELETE /identity/v3/projects/1b38f30ffdc74b66aa2a5ed7d7eb1e0d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:17.923289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:17.923630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:17.923939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:17.944575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:17.945793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:18.008142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1207/2430] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:51:18.015954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.016295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.021142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.035644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:18.036877 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:18.044821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1224/2431] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:18.049615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.059618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d0ffa-cfe4-4ce6-a766-84518006cdd0 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.064280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.065741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.066020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.066295 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.067044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:51:18.067348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.068951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.080372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1208/2432] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:51:18.084649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.095614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a745c0-3ddd-430d-80d2-672c92ea6317 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.100716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.101374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.101652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.101923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.102620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.104597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.234604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1225/2433] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:51:18 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:51:18.235826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.246716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add52a-57d6-4471-a331-39ef1571ec55 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.250627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:18.305568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.306244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.306614 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.307459 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.309044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.311944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.460121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1209/2434] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:51:18 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:51:18.462009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.473243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ab8e9-fe77-4d38-96c2-070389c10bbc admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.478053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.478720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.479012 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.479309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.480026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.481679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.483047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:18.496183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1226/2435] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:51:18.497430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.507913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555d77-ada9-4597-8107-7eb25c05d30e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.512612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410baf4-aaff-4469-83e3-ca0dbfe84f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.513274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410baf4-aaff-4469-83e3-ca0dbfe84f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.513554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410baf4-aaff-4469-83e3-ca0dbfe84f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.513826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410baf4-aaff-4469-83e3-ca0dbfe84f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.514548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410baf4-aaff-4469-83e3-ca0dbfe84f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.516199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410baf4-aaff-4469-83e3-ca0dbfe84f78 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.527202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1210/2436] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:51:18.531475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.542081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be180dd-0958-472f-9a6a-e6b3a1056662 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.546914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.547674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.547954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.548271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] PATH_INFO: `/v3/projects/708bec67bbb748b382b82cd0da768d5c/users/24e3c65a8b344e4e893c3ebf436ac660/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.576733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708bec67bbb748b382b82cd0da768d5c, user_id=24e3c65a8b344e4e893c3ebf436ac660, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.579525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.697955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1227/2437] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:51:18 2022] PUT /identity/v3/projects/708bec67bbb748b382b82cd0da768d5c/users/24e3c65a8b344e4e893c3ebf436ac660/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:18.702952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8acd5d-2f55-4ead-a67b-e75407a5157d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.703246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8acd5d-2f55-4ead-a67b-e75407a5157d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.703528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8acd5d-2f55-4ead-a67b-e75407a5157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.723306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-0c8acd5d-2f55-4ead-a67b-e75407a5157d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:18.724553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-0c8acd5d-2f55-4ead-a67b-e75407a5157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:18.786675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1211/2438] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:18.796317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:18.798048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:18.855881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da126aec-2ce6-4810-a730-ff0287400000 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:18.859694 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:18.860429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:18.860711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:18.860986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:18.870667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:18.872124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:18.882608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1228/2439] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:26.088370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:26.089888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:26.091175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:26.131236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] MFA Rules not processed for user `24e3c65a8b344e4e893c3ebf436ac660`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:26.132544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:26.220728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1212/2440] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:26.222756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:26.236306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39621e13-c8b4-4bcf-a142-9d29ade4791f service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:26.248751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:26.252888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:26.253410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:26.253889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:26.254801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:26.257196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:26.465736 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1229/2441] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:51:26 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:51:26.469964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:26.489278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547345d5-bd39-4b6a-9857-1acc791f8b98 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:26.509521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:26.609562 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:26.610357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:26.611403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:26.612122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:26.613425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:26.615549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:26.760969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1213/2442] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:51:26 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:51:26.761684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:26.778191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69c7c-f6dd-4716-954f-4aa25e3fde81 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:26.791509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:26.792325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:26.792789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:26.793239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:26.794333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:26.797253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:26.829732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1230/2443] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:51:26.834665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:26.847899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191c26a-7e72-4699-97a8-0a413c1a2486 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:26.853564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:26.854483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:26.854769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:26.855052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] PATH_INFO: `/v3/projects/57fc05095ad8465dbef7b7d35be6b200/users/2d6991eda046471f9fa3965bd1e32b01/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:26.880290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fc05095ad8465dbef7b7d35be6b200, user_id=2d6991eda046471f9fa3965bd1e32b01, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:26.883007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:26.984928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:26.985121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1214/2444] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:51:26 2022] PUT /identity/v3/projects/57fc05095ad8465dbef7b7d35be6b200/users/2d6991eda046471f9fa3965bd1e32b01/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:27.001309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2bed6-081e-4094-8455-b906c9edd96a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:27.078750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ed74-336c-4b06-bc37-a1b9f773053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:27.080392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ed74-336c-4b06-bc37-a1b9f773053e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:27.081067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ed74-336c-4b06-bc37-a1b9f773053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:27.081654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ed74-336c-4b06-bc37-a1b9f773053e admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:27.082555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ed74-336c-4b06-bc37-a1b9f773053e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:27.084428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ed74-336c-4b06-bc37-a1b9f773053e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:27.124762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1231/2445] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:51:27.128453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:27.141939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a1d2-79b6-4dea-b7dc-bb2ed66f6f5e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:27.159607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941970-3932-45df-9b93-ec747c64b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:27.161349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941970-3932-45df-9b93-ec747c64b8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:27.162173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941970-3932-45df-9b93-ec747c64b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:27.162953 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941970-3932-45df-9b93-ec747c64b8e0 admin admin] PATH_INFO: `/v3/projects/57fc05095ad8465dbef7b7d35be6b200/users/2d6991eda046471f9fa3965bd1e32b01/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:27.173377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941970-3932-45df-9b93-ec747c64b8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fc05095ad8465dbef7b7d35be6b200, user_id=2d6991eda046471f9fa3965bd1e32b01, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:27.173377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941970-3932-45df-9b93-ec747c64b8e0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:27.187796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1215/2446] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:51:27 2022] PUT /identity/v3/projects/57fc05095ad8465dbef7b7d35be6b200/users/2d6991eda046471f9fa3965bd1e32b01/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:30.181084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:30.181551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:30.181716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:30.213557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] MFA Rules not processed for user `cc438414709747599fba278ea9b6fecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:30.219467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:30.261461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:30.293894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1232/2447] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:34.728969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:34.729885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:34.730357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:34.765142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] MFA Rules not processed for user `2d6991eda046471f9fa3965bd1e32b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:34.766387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:34.930923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1216/2448] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:34.945800 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:34.947910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:35.046443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c595-e247-4ff1-860f-a5ace145076b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:35.054428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:35.055365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:35.056244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:35.056674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:35.145225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:35.147345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:35.157952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1233/2449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:37.387079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:37.468106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141df133-7029-4da3-ad43-bb3096a356a2 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:37.476431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:37.476952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:37.477629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:37.478239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:37.481568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:37.495568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:37.499359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:37.501664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ae8e4-bd54-45cf-acc6-b9e65aeb7310 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:37.513516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1217/2450] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:51:37.815070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:37.828422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9e98-1ea4-493d-8772-ac727fc6378b service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:37.837530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:37.838876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:37.839231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:37.839583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:37.842251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:37.872155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:37.874546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:37.889540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1234/2451] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:38.687545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:38.689034 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:38.689319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:38.713188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] MFA Rules not processed for user `24e3c65a8b344e4e893c3ebf436ac660`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:38.714420 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:38.740240 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1218/2452] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:47.321468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:47.322954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:47.337048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d43f2-9510-4c4f-ad19-7c0d2345d8aa service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:47.342675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:47.343312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:47.343592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:47.343868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:47.346479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:47.356697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:47.358266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:47.367441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1235/2453] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:48.706183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:50.215832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:50.231192 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:50.233260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:50.235547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9aa11-3c2c-4736-8b9f-f8942169da5a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:50.239481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:50.240384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:50.240682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:50.240940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:50.244324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:50.250841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c3b6a-e952-455d-98d3-7cc9dc8ff06a service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:50.261953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:50.261953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:50.261953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:50.261953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:50.262339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:50.271712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:50.273523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:50.283963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1236/2454] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:51:50.343505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:50.346178 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:50.365528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1219/2455] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:54.299388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:54.300925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:54.316421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ad3e1-f221-40eb-8415-bcd010f94ff0 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:54.320928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:54.321788 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:54.322068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:54.322340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] PATH_INFO: `/v3/users/85e0d647620a407cbe03d83c86111f3d` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:54.323517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e0d647620a407cbe03d83c86111f3d)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:54.325498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:54.508148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:54.517600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e0d647620a407cbe03d83c86111f3d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:54.518242 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e0d647620a407cbe03d83c86111f3d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:54.594292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e0d647620a407cbe03d83c86111f3d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:54.594912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e0d647620a407cbe03d83c86111f3d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:54.602559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-403f13aa-44b5-4ad9-a84f-544c3bcbf5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e0d647620a407cbe03d83c86111f3d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:54.620016 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1237/2456] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:51:54 2022] DELETE /identity/v3/users/85e0d647620a407cbe03d83c86111f3d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:55.073762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.083925 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d62f2-1326-4c60-b532-db02ffe7e5ba service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.144164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.145025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.145307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.145584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] PATH_INFO: `/v3/projects/9abd79bc99784c3f81991d1cae37a074` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.146767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abd79bc99784c3f81991d1cae37a074)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.148718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:55.245410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abd79bc99784c3f81991d1cae37a074', 'request_id': 'req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:55.251680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abd79bc99784c3f81991d1cae37a074', 'request_id': 'req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:55.324183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abd79bc99784c3f81991d1cae37a074', 'request_id': 'req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:55.335828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] The token cache is being invalidate because project 9abd79bc99784c3f81991d1cae37a074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:51:55.336156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:55.336788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-24e3163e-7bb5-4ff0-ba08-0e5a0402fa35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:51:55.338444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1220/2457] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:51:55 2022] DELETE /identity/v3/projects/9abd79bc99784c3f81991d1cae37a074 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:55.343424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.343942 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.344267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.362386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:55.363590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:55.422365 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1238/2458] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:55.429859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.430244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.430537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.449358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:55.450557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:55.458626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1221/2459] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:55.462672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.473154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeea7fe-703c-4501-bf58-d9422a7b8da3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.478928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.479597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.479875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.480183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.481297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:51:55.481297 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.482869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:55.495817 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1239/2460] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:51:55.500148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.509446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411eb6d-7b30-44fc-8ec9-edaf5148c8e6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.519691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.525559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.525559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.525559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.525559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.525559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:55.540435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:55.611417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1222/2461] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:51:55 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:51:55.612677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.622867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3fd2b-0c2b-4bb8-8939-be3fbc934a09 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.683229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.683913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.684272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.684536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.685227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.687235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:55.792310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1240/2462] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:51:55 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:51:55.796449 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.812127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89759776-3d7e-4fb6-829a-ba95adfeb3db admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.817898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.818573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.818853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.819134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.819855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.821482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:55.833102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1223/2463] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:51:55.837214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.848553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7005938-704a-41de-b9c8-29fa6af8193c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.853232 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a82dd-1f7f-4f89-a630-9f322be9e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.853905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a82dd-1f7f-4f89-a630-9f322be9e9af admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.854189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a82dd-1f7f-4f89-a630-9f322be9e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.854466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a82dd-1f7f-4f89-a630-9f322be9e9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.855202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a82dd-1f7f-4f89-a630-9f322be9e9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.856848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a82dd-1f7f-4f89-a630-9f322be9e9af admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:55.867244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1241/2464] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:51:55.871339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:55.881566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffd54c-045e-41b5-95db-1b7160b2e366 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:55.886112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:55.886983 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:55.887268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:55.887535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] PATH_INFO: `/v3/projects/b189cf9d8f6448738a8976aa0e9a9390/users/0eaccaa0ecf646e4bafa27867860c173/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:55.902376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b189cf9d8f6448738a8976aa0e9a9390, user_id=0eaccaa0ecf646e4bafa27867860c173, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:55.905068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:56.029448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1224/2465] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:51:55 2022] PUT /identity/v3/projects/b189cf9d8f6448738a8976aa0e9a9390/users/0eaccaa0ecf646e4bafa27867860c173/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:51:56.040395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:56.040686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:56.040977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:56.069961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] MFA Rules not processed for user `0eaccaa0ecf646e4bafa27867860c173`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:51:56.071160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:56.076243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:56.139668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1242/2466] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:51:56.150776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:56.152589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:56.226901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e641255-8ef0-4e9b-a2cc-3d9e5d93449e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:56.232646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:56.233328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:56.233612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:56.233890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:56.241965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:56.243532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:56.252920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1225/2467] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:51:56.545148 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:51:56.547941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:56.624473 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9618fd-f41c-4e65-8942-be190aa95e35 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:51:56.630479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:51:56.631137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:51:56.631421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:51:56.631701 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:51:56.633779 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:51:56.647165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:51:56.649622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d30c-db53-445b-81f9-e1507d98cfc8 service placement] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:51:56.661339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1243/2468] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:05.669670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:05.739900 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf26624-eff6-42ad-a1c8-9400ffcec581 service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:05.748806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:05.748806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:05.748806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:05.748806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] PATH_INFO: `/v3/users/0eaccaa0ecf646e4bafa27867860c173` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:05.749224 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaccaa0ecf646e4bafa27867860c173)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:05.749333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:05.966119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaccaa0ecf646e4bafa27867860c173'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:05.967812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:06.060591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaccaa0ecf646e4bafa27867860c173'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.061213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaccaa0ecf646e4bafa27867860c173'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.061838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaccaa0ecf646e4bafa27867860c173'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.072017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaccaa0ecf646e4bafa27867860c173'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.090597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1226/2469] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:05 2022] DELETE /identity/v3/users/0eaccaa0ecf646e4bafa27867860c173 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:06.096375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:06.096915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:06.097212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:06.123026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:06.124286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:06.188196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1244/2470] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:06.197762 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:06.199232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:06.270774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d000b-58be-49e4-bfb0-963a713068c6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:06.274391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66b96-00c5-44ec-a9ed-672657a744d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:06.275038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66b96-00c5-44ec-a9ed-672657a744d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:06.275320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66b96-00c5-44ec-a9ed-672657a744d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:06.275593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66b96-00c5-44ec-a9ed-672657a744d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:06.285852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66b96-00c5-44ec-a9ed-672657a744d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:06.287281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66b96-00c5-44ec-a9ed-672657a744d3 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:06.297125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1227/2471] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:06.715845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:06.716797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:06.729271 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6e9b4-2a6c-44aa-9549-32dd0a132210 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:06.734783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:06.736311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:06.736811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:06.737317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] PATH_INFO: `/v3/projects/b189cf9d8f6448738a8976aa0e9a9390` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:06.750447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b189cf9d8f6448738a8976aa0e9a9390)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:06.750447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:06.874959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:06.886279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b189cf9d8f6448738a8976aa0e9a9390', 'request_id': 'req-120a0b21-5538-41bf-bcd2-9756897ec4b2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.969657 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b189cf9d8f6448738a8976aa0e9a9390', 'request_id': 'req-120a0b21-5538-41bf-bcd2-9756897ec4b2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.975705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b189cf9d8f6448738a8976aa0e9a9390', 'request_id': 'req-120a0b21-5538-41bf-bcd2-9756897ec4b2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.987953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] The token cache is being invalidate because project b189cf9d8f6448738a8976aa0e9a9390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:06.988268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.988913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-120a0b21-5538-41bf-bcd2-9756897ec4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:06.990468 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1245/2472] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:06 2022] DELETE /identity/v3/projects/b189cf9d8f6448738a8976aa0e9a9390 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:06.995369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:06.995855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:06.996002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.013588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:07.014781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:07.074058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1228/2473] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:07.082208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.082497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.082771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.103206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:07.104482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:07.113060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1246/2474] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:07.117403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.127223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c83c7-e09b-4321-bebb-beb70586aac8 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.131827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.132530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.132818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.133094 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.133823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:52:07.134131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.135741 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.147814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1229/2475] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:52:07.152019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.165861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6482c-417a-4bac-83c9-36baf74b4ac2 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.170616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.171849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.172171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.173213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.173213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.175257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.270013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1247/2476] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:07 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:07.274144 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.284671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033bd4-7563-40fb-8389-1a48c09c3b7e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.335498 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:07.342246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.345175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.345175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.345175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.345175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.347362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.432190 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1230/2477] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:07 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:07.436415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.447330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1af0-ae41-423f-88f9-7ce4be65b7db admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.452001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.453362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.453652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.453932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.454659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.456300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.466906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1248/2478] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:07.471664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.481695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b47fe-2110-4735-bfef-a209012d581d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.487330 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39455f-bf19-4162-8fc9-ed75e76c4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.488065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39455f-bf19-4162-8fc9-ed75e76c4965 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.488560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39455f-bf19-4162-8fc9-ed75e76c4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.489035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39455f-bf19-4162-8fc9-ed75e76c4965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.490031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39455f-bf19-4162-8fc9-ed75e76c4965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.491634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39455f-bf19-4162-8fc9-ed75e76c4965 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.501758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1231/2479] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:07.505603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.515643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e92b5-14a4-474e-b921-3df61c650689 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.520597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.521484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.521771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.522157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] PATH_INFO: `/v3/projects/d66abc5c3a744f5d81c7b64c147dac88/users/9b6da373016c440ebe2dbd6d51ca2ec3/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.537245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66abc5c3a744f5d81c7b64c147dac88, user_id=9b6da373016c440ebe2dbd6d51ca2ec3, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.539889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.632151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1249/2480] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:07 2022] PUT /identity/v3/projects/d66abc5c3a744f5d81c7b64c147dac88/users/9b6da373016c440ebe2dbd6d51ca2ec3/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:07.642855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.643206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.643512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.670655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] MFA Rules not processed for user `9b6da373016c440ebe2dbd6d51ca2ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:07.672463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:07.739587 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1232/2481] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:07.752350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:07.754057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:07.832845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46504-1f38-41d1-abe2-cab54f3197b4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:07.840021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:07.843810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:07.843810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:07.843810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:07.852429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:07.854031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:07.863220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1250/2482] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:10.208588 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:10.222380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07e08a-b67d-4b78-b5a0-403a3464926d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:10.228164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:10.228871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:10.229158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:10.229453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:10.231293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:10.292622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:10.294439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755c71e-0e70-409a-ac26-6aa665f1060c service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:10.304415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1233/2483] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:11.130184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:11.173308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:11.190633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f685-94af-47a8-b3cc-a206df16aff2 service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:11.195099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:11.195965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:11.197892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:11.197892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] PATH_INFO: `/v3/users/9b6da373016c440ebe2dbd6d51ca2ec3` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:11.197892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6da373016c440ebe2dbd6d51ca2ec3)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:11.199577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:11.410601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6da373016c440ebe2dbd6d51ca2ec3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:11.411400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6da373016c440ebe2dbd6d51ca2ec3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:11.502836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6da373016c440ebe2dbd6d51ca2ec3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:11.504005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6da373016c440ebe2dbd6d51ca2ec3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:11.511763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6da373016c440ebe2dbd6d51ca2ec3'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:11.529534 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1251/2484] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:11 2022] DELETE /identity/v3/users/9b6da373016c440ebe2dbd6d51ca2ec3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:11.534886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:11.541468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:11.541468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:11.552731 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:11.553956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:11.616600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1234/2485] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:11.626285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:11.627712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:11.685671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aaf42-4b99-42c2-8487-1e30bf154444 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:11.690316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8dfaa-0cd5-4b62-bfb2-0fdec85b98fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:11.690999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8dfaa-0cd5-4b62-bfb2-0fdec85b98fc service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:11.691286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8dfaa-0cd5-4b62-bfb2-0fdec85b98fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:11.691565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8dfaa-0cd5-4b62-bfb2-0fdec85b98fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:11.700670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8dfaa-0cd5-4b62-bfb2-0fdec85b98fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:11.702122 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8dfaa-0cd5-4b62-bfb2-0fdec85b98fc service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:11.712027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1252/2486] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:12.119350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.120798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:12.130117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:12.136713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecfb05-fd28-47e5-898b-a188a25de89f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.142063 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.142939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.143228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.143624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] PATH_INFO: `/v3/projects/d66abc5c3a744f5d81c7b64c147dac88` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.144736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66abc5c3a744f5d81c7b64c147dac88)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.146554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:12.274248 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66abc5c3a744f5d81c7b64c147dac88', 'request_id': 'req-be4c692b-79c9-40fb-8f24-240d53bbc0fa'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:12.280805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66abc5c3a744f5d81c7b64c147dac88', 'request_id': 'req-be4c692b-79c9-40fb-8f24-240d53bbc0fa'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:12.376709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66abc5c3a744f5d81c7b64c147dac88', 'request_id': 'req-be4c692b-79c9-40fb-8f24-240d53bbc0fa'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:12.387693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] The token cache is being invalidate because project d66abc5c3a744f5d81c7b64c147dac88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:12.387998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:12.388693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-be4c692b-79c9-40fb-8f24-240d53bbc0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:12.390339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1235/2487] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:12 2022] DELETE /identity/v3/projects/d66abc5c3a744f5d81c7b64c147dac88 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:52:12.395203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.395705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.395858 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.414102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:12.415288 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:12.477230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1253/2488] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:12.497853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.499463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.499463 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.518674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:12.519254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:12.527210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1236/2489] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:12.531976 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.538279 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:12.542134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eefad-a1d2-4532-b621-242d483c1cb4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.547456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.548206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.553130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.553130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.553130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:52:12.553130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.553130 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:12.566209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1254/2490] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:52:12.568367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.578235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60374cde-7cb3-4f91-97d3-57727a8a3ce5 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.584679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.585559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.585998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.586427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.587359 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.590049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:12.711363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1237/2491] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:12 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:12.715595 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.727346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3bc1e-a1ca-4c1e-91b9-e5156e3ef0b3 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.787605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.788243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.788528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.788805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.789519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.791576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:12.876488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1255/2492] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:12 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:12.877711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.889139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756a42-7aef-4983-bf7c-7dc8fd359186 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.894519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.895192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.895477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.895752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.896529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.898374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:12.911992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1238/2493] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:12.916572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.926841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dba47-f246-4dee-96e6-323ed8497389 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.931593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aed6dd-cf79-4308-a2c6-ac19ad843d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.932433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aed6dd-cf79-4308-a2c6-ac19ad843d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.932723 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aed6dd-cf79-4308-a2c6-ac19ad843d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.933003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aed6dd-cf79-4308-a2c6-ac19ad843d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.933751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aed6dd-cf79-4308-a2c6-ac19ad843d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.935406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aed6dd-cf79-4308-a2c6-ac19ad843d1d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:12.946149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1256/2494] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:12.950524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:12.963662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fae92-8919-4fca-81a3-bcb4aebd81b8 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:12.970075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:12.971484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:12.971988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:12.972396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] PATH_INFO: `/v3/projects/52ea08b79348459fa6cf9136dad355d9/users/693cd537d2ad496e82aa1d8757fe16f9/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:12.990377 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ea08b79348459fa6cf9136dad355d9, user_id=693cd537d2ad496e82aa1d8757fe16f9, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:12.993454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.116639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1239/2495] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:12 2022] PUT /identity/v3/projects/52ea08b79348459fa6cf9136dad355d9/users/693cd537d2ad496e82aa1d8757fe16f9/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:52:13.130097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.130389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.130669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.160695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] MFA Rules not processed for user `693cd537d2ad496e82aa1d8757fe16f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:13.162110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:13.237738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1257/2496] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:13.242631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:13.310135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d989b1-8129-48f9-bccb-af0a313ce1e7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:13.315082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:13.315747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.316036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.316421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.317119 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:13.319082 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.462385 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1240/2497] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:13 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:13.466482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:13.478274 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f4905-3403-4e6a-a1d6-8f02119785aa None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:13.538647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:13.539330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.539615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.539920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.540654 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:13.542596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.550421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:13.658381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1258/2498] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:13 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:13.662369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:13.673121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4d21-e930-4e26-8bc6-4ed8de95f39a admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:13.678029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:13.678577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.678864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.679147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.679911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:13.681625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.682989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:13.693164 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1241/2499] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:13.697457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:13.708763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5218af2-e850-4129-a087-3315f1d4d64d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:13.713702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:13.714785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.715103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.715383 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] PATH_INFO: `/v3/projects/69166f225154404ab77267f978af33f4/users/957fbb23b04c437597399c1ac71cf9cc/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.732203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69166f225154404ab77267f978af33f4, user_id=957fbb23b04c437597399c1ac71cf9cc, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:13.735575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.851565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1259/2500] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:13 2022] PUT /identity/v3/projects/69166f225154404ab77267f978af33f4/users/957fbb23b04c437597399c1ac71cf9cc/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:52:13.855597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:13.865930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657e90-9f64-4d20-8d93-3834862384fe admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:13.924694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3f7ef-e011-4cbf-a3fb-97984839950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:13.925361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3f7ef-e011-4cbf-a3fb-97984839950a admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.925647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3f7ef-e011-4cbf-a3fb-97984839950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.925927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3f7ef-e011-4cbf-a3fb-97984839950a admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.926652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3f7ef-e011-4cbf-a3fb-97984839950a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:13.928262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3f7ef-e011-4cbf-a3fb-97984839950a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.938901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1242/2501] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:13.943055 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:13.953996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256333d-9e69-438e-a1e8-02426bb6e085 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:13.958732 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:13.959605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.959885 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.960185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] PATH_INFO: `/v3/projects/69166f225154404ab77267f978af33f4/users/957fbb23b04c437597399c1ac71cf9cc/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:13.962196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69166f225154404ab77267f978af33f4, user_id=957fbb23b04c437597399c1ac71cf9cc, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:13.964864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:13.975589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1260/2502] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:13 2022] PUT /identity/v3/projects/69166f225154404ab77267f978af33f4/users/957fbb23b04c437597399c1ac71cf9cc/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:13.986057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:13.986341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:13.986613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:14.013539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] MFA Rules not processed for user `957fbb23b04c437597399c1ac71cf9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:14.015365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:14.082244 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1243/2503] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:14.096409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:14.098218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:14.156870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593fe99-0d0f-4323-83db-64b411b194b0 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:14.160461 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:14.161100 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:14.161382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:14.161658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:14.170661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:14.172173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:14.182136 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1261/2504] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:14.458156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:14.467795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a3c78-8ed3-4700-b961-c585850fe305 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:14.471612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:14.472288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:14.472572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:14.472848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:14.528356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:14.529773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:14.538559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1244/2505] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:17.541231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:17.542687 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:17.599524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c1495-0b8b-44d2-bcd3-689cf4f6d38a service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:17.603021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:17.603656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:17.603933 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:17.604260 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:17.606052 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:17.667840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:17.669392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:17.679098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1262/2506] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:20.072445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:20.073917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:20.094360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:20.151335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af26c-adfe-47aa-8748-cbaad01415a8 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:20.158181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:20.158843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:20.159124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:20.159401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:20.161354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:20.176823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:20.178293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661ab7a-59d9-4af3-8956-3211da7c44ab service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:20.190033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1245/2507] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:26.522154 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:26.527587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:26.585392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75c9b-4a3f-4e1a-9c7f-d0d587b06bd0 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:26.590245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:26.591117 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:26.591399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:26.591675 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] PATH_INFO: `/v3/users/693cd537d2ad496e82aa1d8757fe16f9` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:26.593613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=693cd537d2ad496e82aa1d8757fe16f9)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:26.595803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:26.761212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693cd537d2ad496e82aa1d8757fe16f9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:26.761811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693cd537d2ad496e82aa1d8757fe16f9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:26.844876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693cd537d2ad496e82aa1d8757fe16f9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:26.845493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693cd537d2ad496e82aa1d8757fe16f9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:26.852894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693cd537d2ad496e82aa1d8757fe16f9'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:26.870519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1263/2508] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:26 2022] DELETE /identity/v3/users/693cd537d2ad496e82aa1d8757fe16f9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:26.875147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:26.875644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:26.875744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:26.892318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:26.893493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:26.952383 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1246/2509] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:52:26.961894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:26.963318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:27.023102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ffc75-01de-4d3b-b94e-3529971ea90e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:27.026680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:27.027327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:27.027611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:27.027891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:27.037754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:27.039207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:27.050001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1264/2510] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:27.510043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:27.511529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:27.524616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b72ba-12e1-4b1c-87f4-a766413b864d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:27.529976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:27.531489 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:27.531779 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:27.532076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] PATH_INFO: `/v3/projects/52ea08b79348459fa6cf9136dad355d9` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:27.533372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ea08b79348459fa6cf9136dad355d9)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:27.535276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:27.674570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ea08b79348459fa6cf9136dad355d9', 'request_id': 'req-ddf998ec-286c-4044-b7d0-b410c0ab001c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:27.680725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ea08b79348459fa6cf9136dad355d9', 'request_id': 'req-ddf998ec-286c-4044-b7d0-b410c0ab001c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:27.730605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ea08b79348459fa6cf9136dad355d9', 'request_id': 'req-ddf998ec-286c-4044-b7d0-b410c0ab001c'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:27.742829 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] The token cache is being invalidate because project 52ea08b79348459fa6cf9136dad355d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:27.743152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:27.743805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:27.745464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1247/2511] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:27 2022] DELETE /identity/v3/projects/52ea08b79348459fa6cf9136dad355d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:27.749622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:27.759761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ddb48-cc91-42f4-968e-b31e4fd38980 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:27.788836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:27.820614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:27.821478 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:27.821756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:27.822028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] PATH_INFO: `/v3/users/957fbb23b04c437597399c1ac71cf9cc` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:27.823186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=957fbb23b04c437597399c1ac71cf9cc)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:27.825195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:28.027734 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957fbb23b04c437597399c1ac71cf9cc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.028405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957fbb23b04c437597399c1ac71cf9cc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.132787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957fbb23b04c437597399c1ac71cf9cc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.133465 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957fbb23b04c437597399c1ac71cf9cc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.143509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-f2a8eb66-9868-4329-a18e-d79cac17a04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957fbb23b04c437597399c1ac71cf9cc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.162539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1265/2512] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:27 2022] DELETE /identity/v3/users/957fbb23b04c437597399c1ac71cf9cc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:28.629447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:28.630919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:28.645919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf998ec-286c-4044-b7d0-b410c0ab001c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:28.668779 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:28.712296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:28.713276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:28.713665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:28.714010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] PATH_INFO: `/v3/projects/69166f225154404ab77267f978af33f4` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:28.715355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69166f225154404ab77267f978af33f4)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:28.717947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:28.868657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69166f225154404ab77267f978af33f4', 'request_id': 'req-15c93c49-6bbe-474f-a5f9-51b8282518f3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.875425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69166f225154404ab77267f978af33f4', 'request_id': 'req-15c93c49-6bbe-474f-a5f9-51b8282518f3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.922399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69166f225154404ab77267f978af33f4', 'request_id': 'req-15c93c49-6bbe-474f-a5f9-51b8282518f3'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.933052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] The token cache is being invalidate because project 69166f225154404ab77267f978af33f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:28.933360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.933981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-15c93c49-6bbe-474f-a5f9-51b8282518f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:28.935533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1248/2513] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:28 2022] DELETE /identity/v3/projects/69166f225154404ab77267f978af33f4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:28.942222 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:28.942725 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:28.942841 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:28.961171 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:28.962363 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:29.021324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1266/2514] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:29.029380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.029721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.030011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.048391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:29.049625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:29.057561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1249/2515] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:29.063511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.073413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f80a9-c136-4238-bf81-bc5cf91dbfea None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.078959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.079606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.079890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.080203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.080925 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:52:29.081235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.082837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.095008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1267/2516] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:52:29.099627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.109084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696bb8-1ece-4890-90a3-79838d568c12 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.113969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.114620 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.114902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.115175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.115862 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.117853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.193124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1250/2517] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:29 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:29.197302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.207886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca682-50df-40d6-91ab-b342278430cb admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.238570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:29.265236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.265895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.266172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.266443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.267134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.269080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.368220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1268/2518] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:29 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:29.372273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.384508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac4f2-7ff7-4d60-ad23-44f169e70de9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.389180 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.389881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.390166 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.390445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.391173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.392847 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.403128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1251/2519] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:29.407878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.418163 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4dae6-46eb-446e-840c-f82a6a97b81b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.423359 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595b3f3-5d0d-420a-b03a-6cfa332d45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.424209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b3f3-5d0d-420a-b03a-6cfa332d45b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.424606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b3f3-5d0d-420a-b03a-6cfa332d45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.424835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b3f3-5d0d-420a-b03a-6cfa332d45b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.425789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595b3f3-5d0d-420a-b03a-6cfa332d45b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.428115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595b3f3-5d0d-420a-b03a-6cfa332d45b9 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.438783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1269/2520] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:29.443014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.453017 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333310d9-779a-443f-975d-e3c9b2ea5912 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.457602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.458499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.458784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.459061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] PATH_INFO: `/v3/projects/35cf5075c46e4a5c93b57a0b707cf8ca/users/1aecc913746c463ba14d569a64551fad/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.474270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cf5075c46e4a5c93b57a0b707cf8ca, user_id=1aecc913746c463ba14d569a64551fad, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.477168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.585186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1252/2521] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:29 2022] PUT /identity/v3/projects/35cf5075c46e4a5c93b57a0b707cf8ca/users/1aecc913746c463ba14d569a64551fad/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:29.596494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.596828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.597138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.629774 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] MFA Rules not processed for user `1aecc913746c463ba14d569a64551fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:29.630988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:29.696600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1270/2522] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:29.701858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.757902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:29.769797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725838-006f-4cdb-bd56-49ef2133e717 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.774865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.775564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.775905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.776226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.776922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.778837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:29.881257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1253/2523] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:29 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:29.885741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:29.899191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e72d-c33a-4a19-8024-f5a36f479756 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:29.962644 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:29.963376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:29.963593 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:29.963868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:29.964718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:29.966799 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.044090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1271/2524] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:29 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:30.048474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:30.058914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6e06-9186-43ce-bac9-f600dc86bb6b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:30.064926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:30.065593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.066152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.066545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.067276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:30.068929 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.084539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1254/2525] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:30.085667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:30.096485 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666643c-a39b-4eaf-8569-70e2c7220e3c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:30.101289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:30.102169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.102451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.102730 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] PATH_INFO: `/v3/projects/255c9304a17144cdb4f0b3b9f59482e0/users/9033a59298054031bde26e82382a8820/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.118213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255c9304a17144cdb4f0b3b9f59482e0, user_id=9033a59298054031bde26e82382a8820, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:30.121002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.192597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1272/2526] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:30 2022] PUT /identity/v3/projects/255c9304a17144cdb4f0b3b9f59482e0/users/9033a59298054031bde26e82382a8820/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:52:30.196804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:30.206909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0a53f-6302-46b9-9d01-5d3753c79853 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:30.263570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f337173-ee09-47fe-8e18-ddc34351c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:30.264564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f337173-ee09-47fe-8e18-ddc34351c8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.264843 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f337173-ee09-47fe-8e18-ddc34351c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.265146 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f337173-ee09-47fe-8e18-ddc34351c8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.265855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f337173-ee09-47fe-8e18-ddc34351c8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:30.267441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f337173-ee09-47fe-8e18-ddc34351c8c5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.277289 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1255/2527] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:30.281594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:30.291794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068386c-ee71-4d60-b9e3-eb8520f282b4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:30.297233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:30.298115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.298399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.298672 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] PATH_INFO: `/v3/projects/255c9304a17144cdb4f0b3b9f59482e0/users/9033a59298054031bde26e82382a8820/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.300700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255c9304a17144cdb4f0b3b9f59482e0, user_id=9033a59298054031bde26e82382a8820, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:30.303354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.305589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:30.314870 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1273/2528] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:30 2022] PUT /identity/v3/projects/255c9304a17144cdb4f0b3b9f59482e0/users/9033a59298054031bde26e82382a8820/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:30.325801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.326096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.326501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.352484 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] MFA Rules not processed for user `9033a59298054031bde26e82382a8820`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:30.353702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:30.427786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1256/2529] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:30.438633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:30.440472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:30.503420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487409ea-8b7f-41ba-acc5-cf04ed02e104 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:30.507226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d931-ab8a-4d71-9391-9691811e9a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:30.507874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d931-ab8a-4d71-9391-9691811e9a80 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.508189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d931-ab8a-4d71-9391-9691811e9a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.508471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d931-ab8a-4d71-9391-9691811e9a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.517931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d931-ab8a-4d71-9391-9691811e9a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:30.519367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d931-ab8a-4d71-9391-9691811e9a80 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.530396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1274/2530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:30.658351 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:30.705441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:30.720354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3892d-32af-4683-97d6-1608add5eea6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:30.725170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:30.726045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:30.726327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:30.726600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] PATH_INFO: `/v3/users/1aecc913746c463ba14d569a64551fad` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:30.727797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aecc913746c463ba14d569a64551fad)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:30.729729 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:30.905601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aecc913746c463ba14d569a64551fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:30.991341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aecc913746c463ba14d569a64551fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:30.991956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aecc913746c463ba14d569a64551fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:30.992576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aecc913746c463ba14d569a64551fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.000969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aecc913746c463ba14d569a64551fad'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.020554 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1257/2531] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:30 2022] DELETE /identity/v3/users/1aecc913746c463ba14d569a64551fad => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:31.025318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ed1ef-8a19-47ac-9480-b6d64bc83b6d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:31.025744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ed1ef-8a19-47ac-9480-b6d64bc83b6d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:31.025910 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ed1ef-8a19-47ac-9480-b6d64bc83b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:31.043944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-397ed1ef-8a19-47ac-9480-b6d64bc83b6d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:31.046070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-397ed1ef-8a19-47ac-9480-b6d64bc83b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:31.143062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1275/2532] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:31.152486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:31.154027 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:31.234195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8ee1-c087-45a4-bc0e-15cc11ed7e92 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:31.238748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:31.239179 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:31.239469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:31.239754 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:31.250018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:31.251468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:31.264581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1258/2533] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:31.512397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:31.519924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:31.519924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:31.532588 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:31.533866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:31.593630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1276/2534] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:52:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:52:31.632581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:31.634231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:31.669042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:31.670720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:31.689093 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23f84c-ac3d-4ed0-b8ff-e205a3f5713a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:31.694332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:31.695301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:31.695587 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:31.695956 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] PATH_INFO: `/v3/projects/35cf5075c46e4a5c93b57a0b707cf8ca` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:31.697299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cf5075c46e4a5c93b57a0b707cf8ca)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:31.699420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:31.718821 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553186e-3fb3-4a3b-870f-dfeaf662bf1a service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:31.724718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:31.725523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:31.725935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:31.726217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:31.734909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:31.737738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:31.741742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:31.747528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1259/2535] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:31.811610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:31.823417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cf5075c46e4a5c93b57a0b707cf8ca', 'request_id': 'req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.900499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cf5075c46e4a5c93b57a0b707cf8ca', 'request_id': 'req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.907414 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cf5075c46e4a5c93b57a0b707cf8ca', 'request_id': 'req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.919449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] The token cache is being invalidate because project 35cf5075c46e4a5c93b57a0b707cf8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:31.919733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.920507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:31.925355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1277/2536] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:31 2022] DELETE /identity/v3/projects/35cf5075c46e4a5c93b57a0b707cf8ca => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:31.926551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:31.938744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980fd12-64cf-4684-a42e-80dcf1c8fa47 service swift] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:32.005701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:32.006619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:32.008011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:32.008011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] PATH_INFO: `/v3/users/9033a59298054031bde26e82382a8820` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:32.012654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9033a59298054031bde26e82382a8820)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:32.012654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:32.216270 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9033a59298054031bde26e82382a8820'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:32.343602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9033a59298054031bde26e82382a8820'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:32.344503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9033a59298054031bde26e82382a8820'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:32.345930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9033a59298054031bde26e82382a8820'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:32.366479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9033a59298054031bde26e82382a8820'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:32.419673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1260/2537] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:31 2022] DELETE /identity/v3/users/9033a59298054031bde26e82382a8820 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:33.041301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:33.042776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:33.099576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:33.101235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:33.274647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc716e-5cd7-4108-8c53-ab70e87c0c94 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:33.316582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aed69c-c6bf-4bb6-a67c-974ef57ffd6b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:33.339676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:33.341112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:33.341674 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:33.342380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] PATH_INFO: `/v3/projects/255c9304a17144cdb4f0b3b9f59482e0` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:33.345374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255c9304a17144cdb4f0b3b9f59482e0)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:33.351955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:33.392262 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:33.483861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:33.485704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:33.487019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:33.487382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:33.491996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:33.507999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255c9304a17144cdb4f0b3b9f59482e0', 'request_id': 'req-3a564ff0-dc17-4729-931e-8132be1d0814'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:33.521590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255c9304a17144cdb4f0b3b9f59482e0', 'request_id': 'req-3a564ff0-dc17-4729-931e-8132be1d0814'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:33.527901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:33.533964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b8b2f-d03f-4b1d-8b08-bef12bf94a6e service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:33.558082 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1278/2538] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:33.610590 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255c9304a17144cdb4f0b3b9f59482e0', 'request_id': 'req-3a564ff0-dc17-4729-931e-8132be1d0814'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:33.644808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] The token cache is being invalidate because project 255c9304a17144cdb4f0b3b9f59482e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:33.656229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:33.659757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-3a564ff0-dc17-4729-931e-8132be1d0814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:33.663142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1261/2539] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:33 2022] DELETE /identity/v3/projects/255c9304a17144cdb4f0b3b9f59482e0 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:33.675671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:33.676537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:33.677182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:33.752934 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:33.756011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:33.856287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:33.924982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1279/2540] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:33.926068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:33.926479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:33.926830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:33.993577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:33.994942 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:34.020573 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1262/2541] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:52:34.022255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:34.058143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df2c59-03fa-45a0-a215-7bd62b8d6b47 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:34.073105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:34.074091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.075132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.075422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.076225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:52:34.076733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:34.083070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:34.136513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1280/2542] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:52:34.143880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:34.154906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876469cf-b827-43ff-9c0a-5fc2f401e253 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:34.168744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:34.169471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.169852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.170253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.171096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:34.178368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:34.279039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1263/2543] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:34 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:34.281462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:34.296020 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bd35-47ea-40c9-9f82-ad345784f35e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:34.412989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:34.413842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.414225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.414596 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.415396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:34.420834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:34.526189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1281/2544] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:34 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:34.531438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:34.554344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dca0d-765c-4da5-abab-4dec1dbeaf88 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:34.559785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:34.560218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.560634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.561097 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.561999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:34.564426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:34.581529 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1264/2545] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:34.582311 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:34.593738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a639d1-6bed-43c7-9ae1-0ab34345750a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:34.604681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54ade4-966f-487e-ad9b-248fb4ae7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:34.605679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ade4-966f-487e-ad9b-248fb4ae7308 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.606339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ade4-966f-487e-ad9b-248fb4ae7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.606663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ade4-966f-487e-ad9b-248fb4ae7308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.607381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54ade4-966f-487e-ad9b-248fb4ae7308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:34.609038 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54ade4-966f-487e-ad9b-248fb4ae7308 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:34.623747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1282/2546] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:34.627704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:34.639957 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f757192-5fde-49ff-91a3-1ccbf712860f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:34.645811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:34.646865 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.647215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.647565 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] PATH_INFO: `/v3/projects/92f520a1c541433087f6df850c93271c/users/a980fa94f27a4a8cb8700a7c25080ec2/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.664691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f520a1c541433087f6df850c93271c, user_id=a980fa94f27a4a8cb8700a7c25080ec2, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:34.667466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:34.752716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1265/2547] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:34 2022] PUT /identity/v3/projects/92f520a1c541433087f6df850c93271c/users/a980fa94f27a4a8cb8700a7c25080ec2/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:34.763229 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:34.764477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:34.764608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:34.816739 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] MFA Rules not processed for user `a980fa94f27a4a8cb8700a7c25080ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:34.818364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:34.916119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1283/2548] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:34.926799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:35.022890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108349d-b915-4d3d-a282-82f6bb342395 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:35.035850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:35.036838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:35.037285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:35.037856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:35.038723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:35.041302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:35.155276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1266/2549] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:35.170852 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:35.188196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df862-f2aa-44fd-9d0b-0e20b5447ef1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:35.242391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:35.260044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:35.260935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:35.261289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:35.261634 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:35.262396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:35.265256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:35.617957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1284/2550] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:35 2022] POST /identity/v3/users => generated 296 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:35.622315 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:35.637940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fe297-c895-4e51-9d78-1fac6616a6d9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:35.643958 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:35.644748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:35.645123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:35.645495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:35.646297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:35.648148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:35.660531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1267/2551] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:35.665118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:35.675815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f433-2a3e-4a15-a3d9-6b2743e7d4c7 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:35.695217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:35.695217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:35.695217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:35.695217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] PATH_INFO: `/v3/projects/7f9572bf48564c32a5458c64f97df608/users/445b378790b649ba909490534de2c9c7/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:35.704904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9572bf48564c32a5458c64f97df608, user_id=445b378790b649ba909490534de2c9c7, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:35.708143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:35.823209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1285/2552] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:35 2022] PUT /identity/v3/projects/7f9572bf48564c32a5458c64f97df608/users/445b378790b649ba909490534de2c9c7/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:35.827755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:35.842794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a99a-49bb-4ed5-af16-c899319c9523 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:35.899522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:36.000193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b91a7a-d402-47cc-a359-59af6706a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:36.001580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b91a7a-d402-47cc-a359-59af6706a7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:36.001879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b91a7a-d402-47cc-a359-59af6706a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:36.002162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b91a7a-d402-47cc-a359-59af6706a7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:36.002901 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b91a7a-d402-47cc-a359-59af6706a7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:36.006605 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b91a7a-d402-47cc-a359-59af6706a7c9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:36.024705 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1268/2553] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:52:36.028554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:36.042008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2e0f-e591-4176-83ab-3492ac98b6d8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:36.057509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:36.058677 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:36.059302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:36.059686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] PATH_INFO: `/v3/projects/7f9572bf48564c32a5458c64f97df608/users/445b378790b649ba909490534de2c9c7/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:36.066114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9572bf48564c32a5458c64f97df608, user_id=445b378790b649ba909490534de2c9c7, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:36.073669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:36.090497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1286/2554] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:36 2022] PUT /identity/v3/projects/7f9572bf48564c32a5458c64f97df608/users/445b378790b649ba909490534de2c9c7/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:36.102159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:36.102509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:36.102792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:36.134966 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] MFA Rules not processed for user `445b378790b649ba909490534de2c9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:36.136301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:36.230736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1269/2555] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:36.241515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:36.243848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:36.335496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8ed2-d933-4d51-a99b-9940f1aaebca admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:36.339179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226421db-d68c-4839-af6f-9ef584112c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:36.339833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226421db-d68c-4839-af6f-9ef584112c9f service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:36.340202 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226421db-d68c-4839-af6f-9ef584112c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:36.340498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226421db-d68c-4839-af6f-9ef584112c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:36.355350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226421db-d68c-4839-af6f-9ef584112c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:36.356920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226421db-d68c-4839-af6f-9ef584112c9f service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:36.369015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1287/2556] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:37.069466 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:37.150949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ab129-2566-4de9-abe2-cbaa1d42b01b None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:37.156426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:37.157553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:37.158007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:37.158460 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] PATH_INFO: `/v3/users/a980fa94f27a4a8cb8700a7c25080ec2` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:37.159659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a980fa94f27a4a8cb8700a7c25080ec2)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:37.161781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:37.407106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:37.414634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a980fa94f27a4a8cb8700a7c25080ec2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:37.528312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a980fa94f27a4a8cb8700a7c25080ec2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:37.529069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a980fa94f27a4a8cb8700a7c25080ec2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:37.529795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a980fa94f27a4a8cb8700a7c25080ec2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:37.538819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a980fa94f27a4a8cb8700a7c25080ec2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:37.558542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1270/2557] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:37 2022] DELETE /identity/v3/users/a980fa94f27a4a8cb8700a7c25080ec2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:37.563626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:37.567760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:37.567760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:37.584886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:37.586362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:37.662513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1288/2558] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:52:37.673496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:37.675078 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:37.762371 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2b4a-b4d0-47fb-b9bf-5738a7dcd933 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:37.767502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:37.768472 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:37.771993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:37.771993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:37.779852 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:37.781539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:37.812482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1271/2559] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:38.433355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:38.434835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:38.453787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07e613-fde9-4e50-88f6-9eb405880ef6 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:38.475930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:38.485062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:38.488296 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:38.488690 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] PATH_INFO: `/v3/projects/92f520a1c541433087f6df850c93271c` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:38.490876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f520a1c541433087f6df850c93271c)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:38.493391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:38.687832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:38.700248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f520a1c541433087f6df850c93271c', 'request_id': 'req-685b4a5a-e516-47ca-bcb5-8573cab7911a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:38.787612 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f520a1c541433087f6df850c93271c', 'request_id': 'req-685b4a5a-e516-47ca-bcb5-8573cab7911a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:38.794954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f520a1c541433087f6df850c93271c', 'request_id': 'req-685b4a5a-e516-47ca-bcb5-8573cab7911a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:38.806968 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] The token cache is being invalidate because project 92f520a1c541433087f6df850c93271c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:38.807249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:38.807905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:38.809515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1289/2560] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:38 2022] DELETE /identity/v3/projects/92f520a1c541433087f6df850c93271c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:38.814684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:38.826722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332aa48-fcda-48a9-8c41-84336fa00d92 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:38.905292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:38.906292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:38.906655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:38.906979 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] PATH_INFO: `/v3/users/445b378790b649ba909490534de2c9c7` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:38.908355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445b378790b649ba909490534de2c9c7)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:38.910372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:39.675564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445b378790b649ba909490534de2c9c7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:39.759279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445b378790b649ba909490534de2c9c7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:39.759950 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445b378790b649ba909490534de2c9c7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:39.760593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445b378790b649ba909490534de2c9c7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:39.772211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-705dd748-c5b3-4258-88fe-358666a812a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445b378790b649ba909490534de2c9c7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:39.773609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:39.791125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1272/2561] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:38 2022] DELETE /identity/v3/users/445b378790b649ba909490534de2c9c7 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:52:40.306396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:40.307840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:40.352028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4a5a-e516-47ca-bcb5-8573cab7911a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:40.434921 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:40.438219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:40.438891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:40.439278 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] PATH_INFO: `/v3/projects/7f9572bf48564c32a5458c64f97df608` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:40.441246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9572bf48564c32a5458c64f97df608)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:40.443756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:40.625165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9572bf48564c32a5458c64f97df608', 'request_id': 'req-3df77748-6f40-4980-a29d-c3299d4a2e5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:40.702343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9572bf48564c32a5458c64f97df608', 'request_id': 'req-3df77748-6f40-4980-a29d-c3299d4a2e5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:40.708741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9572bf48564c32a5458c64f97df608', 'request_id': 'req-3df77748-6f40-4980-a29d-c3299d4a2e5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:40.722616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] The token cache is being invalidate because project 7f9572bf48564c32a5458c64f97df608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:40.723185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:40.724008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-3df77748-6f40-4980-a29d-c3299d4a2e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:40.725980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1290/2562] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:40 2022] DELETE /identity/v3/projects/7f9572bf48564c32a5458c64f97df608 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:40.731021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:40.731662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:40.731833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:40.756304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:40.757691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:40.852846 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1273/2563] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:40.866213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04177412-212c-4f79-8217-564cac472762 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:40.867011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04177412-212c-4f79-8217-564cac472762 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:40.867303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04177412-212c-4f79-8217-564cac472762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:40.895741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-04177412-212c-4f79-8217-564cac472762 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:40.895741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-04177412-212c-4f79-8217-564cac472762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:40.902972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1291/2564] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:40.907649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:40.920503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da135aa1-3e57-455d-bcf2-6fa93a1a2791 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:40.926709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:40.927634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:40.927923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:40.928279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:40.929177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:52:40.929485 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:40.931390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:40.949615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1274/2565] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:52:40.953803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04177412-212c-4f79-8217-564cac472762 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:40.964113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04177412-212c-4f79-8217-564cac472762 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:40.970007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:40.970937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:40.971219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:40.971493 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:40.972240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:40.974248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:41.113746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1292/2566] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:52:40 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:41.118039 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:41.149259 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4ea57-772e-4bd6-b503-e6fc9c4c7cb3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:41.257956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:41.258691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:41.258977 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:41.259256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:41.259951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:41.262048 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:41.349347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1275/2567] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:52:41 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:52:41.350514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:41.362582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc4d9-7a93-48a7-9db6-0f4debf2b6a2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:41.368963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:41.369640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:41.369930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:41.370207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:41.370936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:41.372689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:41.402825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1293/2568] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:41.404837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:41.418281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e37c0-d913-4c80-a94d-8c969f03fbf0 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:41.426671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f78f1-b8e3-4f6c-a011-622ec6071905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:41.428247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f78f1-b8e3-4f6c-a011-622ec6071905 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:41.428751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f78f1-b8e3-4f6c-a011-622ec6071905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:41.429323 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f78f1-b8e3-4f6c-a011-622ec6071905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:41.430520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f78f1-b8e3-4f6c-a011-622ec6071905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:41.432655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f78f1-b8e3-4f6c-a011-622ec6071905 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:41.454256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1276/2569] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:52:41.458477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:41.472646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce58127-ace5-4c6d-9208-15f648fd7d7f admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:41.477471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:41.478515 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:41.478971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:41.479416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] PATH_INFO: `/v3/projects/c099b8372da54e83bb5a86ad66140fa5/users/29b9387bb1044d84a7cb7aa71b5bf4c6/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:41.493364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:41.499062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c099b8372da54e83bb5a86ad66140fa5, user_id=29b9387bb1044d84a7cb7aa71b5bf4c6, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:41.501808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:41.577583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1294/2570] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:52:41 2022] PUT /identity/v3/projects/c099b8372da54e83bb5a86ad66140fa5/users/29b9387bb1044d84a7cb7aa71b5bf4c6/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:52:41.592254 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:41.592758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:41.593196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:41.629251 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] MFA Rules not processed for user `29b9387bb1044d84a7cb7aa71b5bf4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:41.630748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:41.682280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:41.725110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1277/2571] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:41.738338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:41.740087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:41.813853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fd5a-bcb8-4b2c-a22d-289fea3c57e6 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:41.818738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02705ab-3ab1-473c-8fde-4aeb8f4f68ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:41.821419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02705ab-3ab1-473c-8fde-4aeb8f4f68ce service glance] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:41.822108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02705ab-3ab1-473c-8fde-4aeb8f4f68ce service glance] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:41.824754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02705ab-3ab1-473c-8fde-4aeb8f4f68ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:41.835441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02705ab-3ab1-473c-8fde-4aeb8f4f68ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:41.837053 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02705ab-3ab1-473c-8fde-4aeb8f4f68ce service glance] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:41.852886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1295/2572] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:44.310881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:44.313151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:44.395709 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcbeb5-e05d-437a-9863-1f2d38dded72 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:44.401544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:44.402197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:44.402482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:44.402761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:44.405414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:44.423263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:44.423263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:44.430365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1278/2573] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:46.382833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93bd9d-db8c-4ac1-95de-e0e559e6412d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:46.388688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93bd9d-db8c-4ac1-95de-e0e559e6412d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:46.388688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93bd9d-db8c-4ac1-95de-e0e559e6412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:46.403213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-aa93bd9d-db8c-4ac1-95de-e0e559e6412d None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:46.404559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-aa93bd9d-db8c-4ac1-95de-e0e559e6412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:46.470110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1296/2574] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 8 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:46.482544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:46.494863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:46.558640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e011d7-56dd-4053-aa68-c089fe84d886 service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:46.565318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc12d3-8f31-4cd1-a326-8071cdf06010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:46.565986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc12d3-8f31-4cd1-a326-8071cdf06010 service swift] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:46.566298 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc12d3-8f31-4cd1-a326-8071cdf06010 service swift] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:46.566576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc12d3-8f31-4cd1-a326-8071cdf06010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:46.575198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc12d3-8f31-4cd1-a326-8071cdf06010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:46.576834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc12d3-8f31-4cd1-a326-8071cdf06010 service swift] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:46.585050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1279/2575] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:52:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:51.540382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13061f-6500-4665-9a19-8d75adff8c54 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:51.543206 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13061f-6500-4665-9a19-8d75adff8c54 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:51.543706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13061f-6500-4665-9a19-8d75adff8c54 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:51.546037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1297/2576] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:52:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:52:51.552195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f1fa-276f-4285-a5c4-09d6fe70f801 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:51.553036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f1fa-276f-4285-a5c4-09d6fe70f801 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:51.553325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f1fa-276f-4285-a5c4-09d6fe70f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:51.583040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-63b0f1fa-276f-4285-a5c4-09d6fe70f801 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:51.587402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-63b0f1fa-276f-4285-a5c4-09d6fe70f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:51.603972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1280/2577] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:52:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:52:51.620907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13061f-6500-4665-9a19-8d75adff8c54 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:51.623460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2e13061f-6500-4665-9a19-8d75adff8c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:51.642699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13061f-6500-4665-9a19-8d75adff8c54 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:51.649184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8da8c-4fb2-4017-b049-11970cb39dc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cbadd181ac245969a762c302998fee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:51.649184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8da8c-4fb2-4017-b049-11970cb39dc3 service glance] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:51.649184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8da8c-4fb2-4017-b049-11970cb39dc3 service glance] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:51.649184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8da8c-4fb2-4017-b049-11970cb39dc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:51.673891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8da8c-4fb2-4017-b049-11970cb39dc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:51.676277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8da8c-4fb2-4017-b049-11970cb39dc3 service glance] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:51.694436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1298/2578] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:51.945241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420f541-6aa0-4b34-88f0-ac70011f7488 None None] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:51.945533 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420f541-6aa0-4b34-88f0-ac70011f7488 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:51.946117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420f541-6aa0-4b34-88f0-ac70011f7488 None None] PATH_INFO: `/` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:51.947402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1281/2579] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:52:51.954251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:51.955030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:51.955315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:51.977101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] MFA Rules not processed for user `7e6c3fd9ddab4118abf1729ac9a8f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:51.978586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:51.994426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420f541-6aa0-4b34-88f0-ac70011f7488 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:51.996676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-0420f541-6aa0-4b34-88f0-ac70011f7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:52.055619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1299/2580] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:52:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:52.065416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:52.069277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:52.073397 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:52.083531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc3696-1619-4dac-b266-d06c7775190c None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:52.088181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484ab53-cc30-498b-ae25-31219514801a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:52.088362 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484ab53-cc30-498b-ae25-31219514801a service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:52.088597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484ab53-cc30-498b-ae25-31219514801a service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:52.088906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484ab53-cc30-498b-ae25-31219514801a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:52.097745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484ab53-cc30-498b-ae25-31219514801a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:52.099389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484ab53-cc30-498b-ae25-31219514801a service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:52.099487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420f541-6aa0-4b34-88f0-ac70011f7488 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:52.104723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:52.105455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:52.105779 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:52.106056 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:52.107994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1300/2581] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:52:52.113061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:52.125917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:52.130599 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918954d9-d8a1-4b77-a169-972304d496a1 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:52.140675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1282/2582] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:52.228733 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a844b3-e912-4f4a-a83b-fc7d3869e6f6 None None] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:52.229026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a844b3-e912-4f4a-a83b-fc7d3869e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:52.229526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a844b3-e912-4f4a-a83b-fc7d3869e6f6 None None] PATH_INFO: `/` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:52.231761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1301/2583] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 8 13:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 13:52:52.239763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30498896-1adb-4b1d-a198-569d073f24d2 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:52.240083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30498896-1adb-4b1d-a198-569d073f24d2 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:52.240382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30498896-1adb-4b1d-a198-569d073f24d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:52.262384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-30498896-1adb-4b1d-a198-569d073f24d2 None None] MFA Rules not processed for user `796757d15819413f8486471e778d95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:52.264671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-30498896-1adb-4b1d-a198-569d073f24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:52.277412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1283/2584] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 8 13:52:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:52.291876 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a844b3-e912-4f4a-a83b-fc7d3869e6f6 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:52.305741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a844b3-e912-4f4a-a83b-fc7d3869e6f6 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:52.310203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:52.316319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:52.316319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:52.316319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:52.330261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:52.331867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:52.345931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1302/2585] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:55.848972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:55.849564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:55.849564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:55.868854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:52:55.870084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:55.877943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1284/2586] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:52:55.890685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:55.902512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9b3f2-78f6-4b98-aa5c-737ca1c29e73 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:55.908472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:55.909181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:55.909532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:55.909878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:55.915235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:55.918844 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:55.920646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:55.946912 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1303/2587] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:52:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:56.666193 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:56.688243 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa439-5939-457d-ac65-2fef079aeace None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:56.705028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:56.706992 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:56.707437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:56.708011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:56.711057 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:56.739455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:56.741475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:56.767654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1285/2588] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:52:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:52:56.862648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:56.865239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:56.937548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89872882-130d-4b54-be1b-172a134d9983 service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:56.942567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:56.943539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:56.943894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:56.944422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] PATH_INFO: `/v3/users/d6bd0d1fd6be41a3a711be3fb4c0cbfc` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:56.945770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bd0d1fd6be41a3a711be3fb4c0cbfc)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:56.947806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:57.122303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.123264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.182355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.183338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.195433 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.217033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1304/2589] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:56 2022] DELETE /identity/v3/users/d6bd0d1fd6be41a3a711be3fb4c0cbfc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:57.485660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:57.499338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d098d6a-05c9-4687-8814-0da3a9978641 service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:57.575784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:57.576807 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:57.577211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:57.577500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] PATH_INFO: `/v3/projects/14385fc22a1d4de4bc0af0c764f6ef69` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:57.578835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14385fc22a1d4de4bc0af0c764f6ef69)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:57.581000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:57.678923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14385fc22a1d4de4bc0af0c764f6ef69', 'request_id': 'req-a13cefaf-07d1-4548-ad19-4b4e814c0c03'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.689781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14385fc22a1d4de4bc0af0c764f6ef69', 'request_id': 'req-a13cefaf-07d1-4548-ad19-4b4e814c0c03'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.787390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14385fc22a1d4de4bc0af0c764f6ef69', 'request_id': 'req-a13cefaf-07d1-4548-ad19-4b4e814c0c03'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.800639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] The token cache is being invalidate because project 14385fc22a1d4de4bc0af0c764f6ef69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:57.801075 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.801871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:57.803878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1286/2590] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:57 2022] DELETE /identity/v3/projects/14385fc22a1d4de4bc0af0c764f6ef69 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:57.807669 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:57.809807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:57.858398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69133b2b-c744-40dc-abd1-679c8738ddba admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:57.948627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:57.948627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:57.948627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:57.948627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] PATH_INFO: `/v3/users/663f2377a76f4d608a1b37b3794453e5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:57.949444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=663f2377a76f4d608a1b37b3794453e5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:57.949444 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:57.965504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:58.214225 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663f2377a76f4d608a1b37b3794453e5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.214978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663f2377a76f4d608a1b37b3794453e5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.339512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663f2377a76f4d608a1b37b3794453e5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.340839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663f2377a76f4d608a1b37b3794453e5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.349935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-79885f5d-df78-4954-9969-26e5393ec37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663f2377a76f4d608a1b37b3794453e5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.368503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1305/2591] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:52:57 2022] DELETE /identity/v3/users/663f2377a76f4d608a1b37b3794453e5 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:52:58.656625 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:52:58.658333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:52:58.675579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cefaf-07d1-4548-ad19-4b4e814c0c03 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:52:58.732743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:58.761356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:52:58.762926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:52:58.763401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:52:58.763850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] PATH_INFO: `/v3/projects/d577681733474beb8e17acfa66ccba7e` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:52:58.765142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d577681733474beb8e17acfa66ccba7e)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:52:58.766882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:52:58.902029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd577681733474beb8e17acfa66ccba7e', 'request_id': 'req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.909499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd577681733474beb8e17acfa66ccba7e', 'request_id': 'req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.979889 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd577681733474beb8e17acfa66ccba7e', 'request_id': 'req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:58.997494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] The token cache is being invalidate because project d577681733474beb8e17acfa66ccba7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:52:58.999721 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:59.000516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:52:59.002649 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1287/2592] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:52:58 2022] DELETE /identity/v3/projects/d577681733474beb8e17acfa66ccba7e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:53:08.364623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:09.004290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:15.462704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:15.463221 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:15.463309 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:15.484146 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:15.485368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:15.541938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1306/2593] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 8 13:53:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:15.555261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:15.558211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:15.627470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98abd4-b1e6-4f78-8d01-2cc72bf241f2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:15.632702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:15.633360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:15.633696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:15.633916 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:15.642438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:15.644014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:15.652669 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1288/2594] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:53:17.639402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:17.644298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:17.697305 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7834a9-5f94-4f3c-8ed9-caad943ac9cf None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:17.700754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:17.701395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:17.701681 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:17.701953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:17.703709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:17.766643 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:17.768199 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811deba-5df8-47f3-930a-63674ff13626 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:17.778337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1307/2595] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:53:18.024776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:18.026242 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:18.039995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b2b07-881d-4b8a-9f33-fc596fe93328 service swift] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:18.045112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:18.045986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:18.046265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:18.046652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] PATH_INFO: `/v3/users/29b9387bb1044d84a7cb7aa71b5bf4c6` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:18.047842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b9387bb1044d84a7cb7aa71b5bf4c6)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:18.049783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:18.200445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b9387bb1044d84a7cb7aa71b5bf4c6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:18.266131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b9387bb1044d84a7cb7aa71b5bf4c6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:18.266725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b9387bb1044d84a7cb7aa71b5bf4c6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:18.267333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b9387bb1044d84a7cb7aa71b5bf4c6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:18.274872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b9387bb1044d84a7cb7aa71b5bf4c6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:18.294789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1289/2596] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:53:18 2022] DELETE /identity/v3/users/29b9387bb1044d84a7cb7aa71b5bf4c6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:53:18.299275 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:18.299565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:18.299840 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:18.317776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:18.319239 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:18.389388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:18.400394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1308/2597] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:18.413104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:18.414577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:18.473772 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f38b-d328-4c24-b9d0-a5f4aef992b3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:18.477384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:18.478031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:18.478312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:18.478584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:18.487888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:18.489340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:18.499640 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1290/2598] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:53:19.291264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:19.293412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:19.305717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650fe7e-8cfd-4029-886f-cbc58c8a80db None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:19.311437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:19.312354 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:19.312642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:19.312918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] PATH_INFO: `/v3/projects/c099b8372da54e83bb5a86ad66140fa5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:19.314131 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c099b8372da54e83bb5a86ad66140fa5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:19.316073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:19.444191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c099b8372da54e83bb5a86ad66140fa5', 'request_id': 'req-71c70ce0-99d8-4c1c-a673-36ea90505c93'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:19.506152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c099b8372da54e83bb5a86ad66140fa5', 'request_id': 'req-71c70ce0-99d8-4c1c-a673-36ea90505c93'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:19.512545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c099b8372da54e83bb5a86ad66140fa5', 'request_id': 'req-71c70ce0-99d8-4c1c-a673-36ea90505c93'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:19.524005 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] The token cache is being invalidate because project c099b8372da54e83bb5a86ad66140fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:53:19.524321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:19.524971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:19.527340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1309/2599] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:53:19 2022] DELETE /identity/v3/projects/c099b8372da54e83bb5a86ad66140fa5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:53:21.552685 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:21.554121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:21.564161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:21.567972 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241032-9e3f-4624-a8a3-1b616fc87b19 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:21.624632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:21.625546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:21.625828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:21.626108 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] PATH_INFO: `/v3/users/cc438414709747599fba278ea9b6fecf` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:21.627293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc438414709747599fba278ea9b6fecf)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:21.629230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:21.801040 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc438414709747599fba278ea9b6fecf'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:21.870198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc438414709747599fba278ea9b6fecf'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:21.871442 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc438414709747599fba278ea9b6fecf'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:21.872148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc438414709747599fba278ea9b6fecf'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:21.879659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-0732a9dc-a629-434c-84b1-e415948534fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc438414709747599fba278ea9b6fecf'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:21.897680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1291/2600] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:53:21 2022] DELETE /identity/v3/users/cc438414709747599fba278ea9b6fecf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:53:22.145747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.147236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:22.161989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70ce0-99d8-4c1c-a673-36ea90505c93 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.221769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.222633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.222914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.223187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] PATH_INFO: `/v3/projects/87c115dc845a497292c12e2980e9f77b` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.224404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c115dc845a497292c12e2980e9f77b)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.226340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:22.323259 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c115dc845a497292c12e2980e9f77b', 'request_id': 'req-c07deff5-4913-4647-945e-9a61574d6ee6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:22.400886 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c115dc845a497292c12e2980e9f77b', 'request_id': 'req-c07deff5-4913-4647-945e-9a61574d6ee6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:22.406405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c115dc845a497292c12e2980e9f77b', 'request_id': 'req-c07deff5-4913-4647-945e-9a61574d6ee6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:22.417436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] The token cache is being invalidate because project 87c115dc845a497292c12e2980e9f77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:53:22.417722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:22.418341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c07deff5-4913-4647-945e-9a61574d6ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:53:22.419907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1310/2601] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:53:22 2022] DELETE /identity/v3/projects/87c115dc845a497292c12e2980e9f77b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:53:22.424859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.425142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.425417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.446028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:22.447223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:22.505101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1292/2602] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:22.514110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.514405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.514682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.532924 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:22.534128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:22.542676 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1311/2603] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:22.546930 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.556443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba415-0998-43f9-a334-6ee904376b02 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.561571 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.562217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.562496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.562769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.563515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:53:22.563817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.565490 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:22.576896 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1293/2604] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:53:22.581435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.585898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:22.591071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c07ce-b057-42d2-af26-dd96eab06ec3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.595954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.596629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.596909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.597187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.597905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.599816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:22.684907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1312/2605] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:53:22 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:53:22.689212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.699280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa55d-62cc-4bd1-9c78-ec57dc304be5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.706921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:22.755654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.756372 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.756659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.756938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.757626 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.759531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:22.842744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1294/2606] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:53:22 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:53:22.847195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.858421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6ed40-fa0a-49cb-ba23-c862926ae6b8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.863112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.863767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.864066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.864350 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.865065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.866661 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:22.877323 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1313/2607] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:53:22.881104 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.891470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f1d3-efd7-4d08-aef2-014fef9f74dd admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.896122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455f34-9828-4f68-b5ed-f13e45ce8c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.896785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455f34-9828-4f68-b5ed-f13e45ce8c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.897069 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455f34-9828-4f68-b5ed-f13e45ce8c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.897344 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455f34-9828-4f68-b5ed-f13e45ce8c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.898065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455f34-9828-4f68-b5ed-f13e45ce8c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.899643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455f34-9828-4f68-b5ed-f13e45ce8c15 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:22.910206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1295/2608] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:53:22.914343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:22.925411 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4a629-6055-4658-b999-57acf1e59dc4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:22.930004 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:22.930871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:22.931157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:22.931439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] PATH_INFO: `/v3/projects/9015bc58fb5948a9bbc41ef874faede5/users/e50a12d7facd4e4184d79bbac03bfa74/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:22.946217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9015bc58fb5948a9bbc41ef874faede5, user_id=e50a12d7facd4e4184d79bbac03bfa74, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:22.949174 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:23.054471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1314/2609] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:53:22 2022] PUT /identity/v3/projects/9015bc58fb5948a9bbc41ef874faede5/users/e50a12d7facd4e4184d79bbac03bfa74/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:53:23.060255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4cb2-5610-499c-8530-a8fee94a747f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:23.060549 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4cb2-5610-499c-8530-a8fee94a747f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:23.060833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4cb2-5610-499c-8530-a8fee94a747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:23.079513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-cdde4cb2-5610-499c-8530-a8fee94a747f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:23.080743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cdde4cb2-5610-499c-8530-a8fee94a747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:23.140601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1296/2610] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:23.150097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:23.151812 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:23.209340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584454d-b613-4056-bc1b-6214a7012f27 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:23.212880 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:23.213517 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:23.213798 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:23.214745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:23.224262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:23.225714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:23.235828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1315/2611] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:53:28.837512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e242-e660-47d9-95e4-aea831b9ed23 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:28.838044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e242-e660-47d9-95e4-aea831b9ed23 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:28.838216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e242-e660-47d9-95e4-aea831b9ed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:28.875831 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-2084e242-e660-47d9-95e4-aea831b9ed23 None None] MFA Rules not processed for user `e50a12d7facd4e4184d79bbac03bfa74`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:28.880809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2084e242-e660-47d9-95e4-aea831b9ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:28.951375 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1297/2612] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:28.968165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:28.969873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:29.048541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8a711-2d69-4a76-a71c-91d25eb62401 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:29.054679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:29.055346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:29.055627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:29.055903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:29.065789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:29.067400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:29.078277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1316/2613] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:53:31.560651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:31.561228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:31.561228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:31.582608 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] MFA Rules not processed for user `e50a12d7facd4e4184d79bbac03bfa74`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:53:31.583877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:31.594045 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1298/2614] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:53:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:53:32.014481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:32.024556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4e3c-1c9b-4ecf-a29e-22dd4131bdab service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:32.030762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:32.031421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:32.031704 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:32.031981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:32.033965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:32.045105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:32.046565 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:32.055872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1317/2615] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:53:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:53:41.576486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:42.052450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=93,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:57.144813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:53:57.154509 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafa461-40a5-4c56-aa6d-a05924989127 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:53:57.158186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:53:57.158827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:53:57.159114 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:53:57.159394 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:53:57.161258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:53:57.173686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:53:57.175099 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:53:57.185401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1299/2616] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:00.734685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:00.735509 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:00.752536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4847ae-8305-4685-a37f-06900e2a4364 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:00.757092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:00.757962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:00.758241 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:00.758511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] PATH_INFO: `/v3/users/1b970b89c20645d98da510e03a915fd5` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:00.760459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b970b89c20645d98da510e03a915fd5)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:00.762381 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:00.911954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b970b89c20645d98da510e03a915fd5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:00.912554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b970b89c20645d98da510e03a915fd5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:00.982392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b970b89c20645d98da510e03a915fd5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:00.983007 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b970b89c20645d98da510e03a915fd5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:00.990066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-843799fd-363b-4f31-99ec-e03191a981db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b970b89c20645d98da510e03a915fd5'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:01.007706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1318/2617] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:00 2022] DELETE /identity/v3/users/1b970b89c20645d98da510e03a915fd5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:54:01.242815 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:01.255445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8db68-e83b-4679-aa82-a83d7e2dd4a7 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:01.314135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:01.315089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.315374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.315653 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] PATH_INFO: `/v3/projects/d0cc65fa99694daa81878db0200bdb4b` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.316867 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cc65fa99694daa81878db0200bdb4b)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:01.318748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:01.413274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cc65fa99694daa81878db0200bdb4b', 'request_id': 'req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:01.420076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cc65fa99694daa81878db0200bdb4b', 'request_id': 'req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:01.470570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cc65fa99694daa81878db0200bdb4b', 'request_id': 'req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:01.482934 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] The token cache is being invalidate because project d0cc65fa99694daa81878db0200bdb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:01.483263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:01.483903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9b1cc7a3-fd65-4491-b099-fd76d9bbad78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:01.485566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1300/2618] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:01 2022] DELETE /identity/v3/projects/d0cc65fa99694daa81878db0200bdb4b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:01.492772 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.492999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.493426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.511415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:01.516210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:01.573257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1319/2619] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:01.581569 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.581866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.582150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.601454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:01.602764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:01.610775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1301/2620] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:01.614882 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:01.624796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5f57-6c4e-40ea-ba70-cfc53fa9e2fd None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:01.629404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:01.630057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.630347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.630623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.631341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:54:01.631648 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:01.633295 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:01.645597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1320/2621] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:54:01.650522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:01.659733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0bac7-118a-4888-8800-c7265ff2cd2a None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:01.664432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:01.665086 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.665366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.665650 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.666346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:01.668261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:01.752850 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1302/2622] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:01 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:54:01.756996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:01.767466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1186c-d2a6-4d2b-9a1d-f271be294982 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:01.829937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:01.830623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.830908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.831184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.831887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:01.833908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:01.841818 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:01.922476 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1321/2623] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:01 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:01.926572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:01.937732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809715e8-186b-4e82-a51d-2f08ab138f2c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:01.942654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:01.943402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.943708 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.944018 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.944781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:01.947453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:01.958435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1303/2624] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:01.963025 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:01.973507 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4bb5b-b84f-4342-8faa-a2ec9b4a2b4c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:01.978246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff86f5-b63c-40a4-b36d-1f67c411ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:01.978897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff86f5-b63c-40a4-b36d-1f67c411ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:01.979177 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff86f5-b63c-40a4-b36d-1f67c411ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:01.979469 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff86f5-b63c-40a4-b36d-1f67c411ff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:01.980214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff86f5-b63c-40a4-b36d-1f67c411ff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:01.981796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff86f5-b63c-40a4-b36d-1f67c411ff8c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:01.992862 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1322/2625] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:01.998275 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.008348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a166f-c309-4005-ae05-7facb43488e6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.014117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.015033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.015316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.015670 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] PATH_INFO: `/v3/projects/606d2e3572dd48c6b8cd005da1254e37/users/224da27c210a4838aa43369abc08f56d/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.030110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606d2e3572dd48c6b8cd005da1254e37, user_id=224da27c210a4838aa43369abc08f56d, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.032773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:02.105188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1304/2626] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:01 2022] PUT /identity/v3/projects/606d2e3572dd48c6b8cd005da1254e37/users/224da27c210a4838aa43369abc08f56d/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:02.115467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.115756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.116035 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.143189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] MFA Rules not processed for user `224da27c210a4838aa43369abc08f56d`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:02.144438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:02.209183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1323/2627] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:02.213933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.227636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:02.275391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac87b69-9076-446d-8530-37cbb69e0aa3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.280140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.280811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.281096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.281376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.282066 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.284026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:02.409003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1305/2628] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:02 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:02.423077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.434491 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6c707-45e6-4514-9f6d-c4717ffefac5 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.490406 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.491077 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.491366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.491646 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.492373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.495253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:02.611632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1324/2629] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:02 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:02.615574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.626547 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00bf84-4f77-4477-aef3-c41dd6d0b06c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.631126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.632524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.632524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.632524 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.633095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.635049 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:02.645483 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1306/2630] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:02.649204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.659655 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ebc1-a4ef-4934-a3dd-8da0d10ab027 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.664332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03818317-bb71-42dc-9cc4-5f31e78c1d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.664996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818317-bb71-42dc-9cc4-5f31e78c1d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.665909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818317-bb71-42dc-9cc4-5f31e78c1d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.666231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818317-bb71-42dc-9cc4-5f31e78c1d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.666981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03818317-bb71-42dc-9cc4-5f31e78c1d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.668614 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03818317-bb71-42dc-9cc4-5f31e78c1d30 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:02.678462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1325/2631] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:02.682751 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.692654 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796035-a79a-423e-8cc2-cb3298131620 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.697268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.698133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.698417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.698693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] PATH_INFO: `/v3/projects/c10a9d371baa40f29ea1de79c1c619a6/users/045aecd0bf9149eabe47974d9692d94a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.713662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10a9d371baa40f29ea1de79c1c619a6, user_id=045aecd0bf9149eabe47974d9692d94a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.716312 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:02.817737 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1307/2632] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:02 2022] PUT /identity/v3/projects/c10a9d371baa40f29ea1de79c1c619a6/users/045aecd0bf9149eabe47974d9692d94a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:02.829386 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.829936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.829936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.857630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] MFA Rules not processed for user `045aecd0bf9149eabe47974d9692d94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:02.858824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:02.892642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:02.923128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1326/2633] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:02.927607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:02.991131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd41e7c-299c-4fd9-b95d-0b6ccbfd67d3 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:02.995812 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:02.996499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:02.996788 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:02.997068 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:02.997766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:02.999662 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.110610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1308/2634] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:02 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:03.114854 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:03.126002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69fbd-d91b-477c-9f9d-77135e011daa None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:03.182545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:03.183143 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.183428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.183705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.184429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:03.186366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.263546 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1327/2635] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:03 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:03.267572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:03.278844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc91ba4-c47a-4ce6-945f-5f663bdd6107 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:03.283690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:03.284398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.284689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.284969 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.285701 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:03.287413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.299536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1309/2636] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:03.303649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:03.313805 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2b75-327b-4549-9783-6463ce3f582c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:03.318366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:03.319257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.319541 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.319815 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] PATH_INFO: `/v3/projects/3db0083576a24e51b475390d487d2be4/users/a3ec279f9997496bbeea117041f64078/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.334908 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db0083576a24e51b475390d487d2be4, user_id=a3ec279f9997496bbeea117041f64078, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:03.338428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.418142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1328/2637] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:03 2022] PUT /identity/v3/projects/3db0083576a24e51b475390d487d2be4/users/a3ec279f9997496bbeea117041f64078/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:03.422437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:03.433172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dcc69-5fbf-4c65-baa6-9c5b5fc96446 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:03.466030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:03.488255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ece2c7-6240-4533-8ac8-7da7e0d4373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:03.488918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ece2c7-6240-4533-8ac8-7da7e0d4373a admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.489195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ece2c7-6240-4533-8ac8-7da7e0d4373a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.489470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ece2c7-6240-4533-8ac8-7da7e0d4373a admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.490218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ece2c7-6240-4533-8ac8-7da7e0d4373a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:03.491795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ece2c7-6240-4533-8ac8-7da7e0d4373a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.502140 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1310/2638] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:03.506625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:03.517998 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843033c-32f6-41e5-88c6-24fb4ad98783 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:03.522804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:03.523684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.523966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.524303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] PATH_INFO: `/v3/projects/3db0083576a24e51b475390d487d2be4/users/a3ec279f9997496bbeea117041f64078/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.526564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db0083576a24e51b475390d487d2be4, user_id=a3ec279f9997496bbeea117041f64078, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:03.529332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.539808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1329/2639] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:03 2022] PUT /identity/v3/projects/3db0083576a24e51b475390d487d2be4/users/a3ec279f9997496bbeea117041f64078/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:03.550946 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.551326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.551730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.578961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] MFA Rules not processed for user `a3ec279f9997496bbeea117041f64078`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:03.580183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:03.645918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1311/2640] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:03.656372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:03.658081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:03.716695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9296ff-3eaf-43e0-97fe-552de0d760b8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:03.720481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:03.721124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:03.721402 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:03.721674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:03.731680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:03.733166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:03.742582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1330/2641] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:04.761715 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:04.763163 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:04.775948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb486f-8281-4c6d-88ac-532a6316c04f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:04.779437 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:04.780096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:04.780382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:04.780659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:04.836849 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:04.838582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:04.847755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1312/2642] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:09.757388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:09.766463 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e865af-da50-40ed-ba2f-a10dd84e4bf7 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:09.770175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f8fd-2dcc-4f1a-a889-3ab8062ebc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:09.770993 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f8fd-2dcc-4f1a-a889-3ab8062ebc6f service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:09.771283 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f8fd-2dcc-4f1a-a889-3ab8062ebc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:09.771555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f8fd-2dcc-4f1a-a889-3ab8062ebc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:09.802101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:09.830145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f8fd-2dcc-4f1a-a889-3ab8062ebc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:09.831594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f8fd-2dcc-4f1a-a889-3ab8062ebc6f service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:09.841124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1331/2643] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:13.816384 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:13.875783 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:13.879902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6720f2-3eb1-41bf-9159-0337625a2a61 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:13.885105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:13.886007 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:13.886285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:13.886563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] PATH_INFO: `/v3/users/224da27c210a4838aa43369abc08f56d` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:13.887770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224da27c210a4838aa43369abc08f56d)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:13.889755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:14.129304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224da27c210a4838aa43369abc08f56d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:14.223192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224da27c210a4838aa43369abc08f56d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:14.223833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224da27c210a4838aa43369abc08f56d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:14.224468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224da27c210a4838aa43369abc08f56d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:14.232686 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224da27c210a4838aa43369abc08f56d'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:14.251026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1313/2644] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:13 2022] DELETE /identity/v3/users/224da27c210a4838aa43369abc08f56d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:14.255691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:14.256187 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:14.256285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:14.273720 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:14.274932 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:14.336940 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1332/2645] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:14.347560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:14.348941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:14.405535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113d7fb-d72b-48f3-b3c6-6b46b7a68e62 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:14.409076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:14.409718 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:14.410006 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:14.410279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:14.419974 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:14.421422 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:14.430717 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1314/2646] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:14.858744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:14.860185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:14.872511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b5060-2160-488e-8ea9-635050cb6e82 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:14.877227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:14.878095 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:14.878370 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:14.878640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] PATH_INFO: `/v3/projects/606d2e3572dd48c6b8cd005da1254e37` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:14.879920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] RBAC: Authorizing `identity:delete_project(project_id=606d2e3572dd48c6b8cd005da1254e37)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:14.881904 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:14.978753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606d2e3572dd48c6b8cd005da1254e37', 'request_id': 'req-32980f7c-e98b-4584-9b67-c025c847860d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.052645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606d2e3572dd48c6b8cd005da1254e37', 'request_id': 'req-32980f7c-e98b-4584-9b67-c025c847860d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.059298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606d2e3572dd48c6b8cd005da1254e37', 'request_id': 'req-32980f7c-e98b-4584-9b67-c025c847860d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.070114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] The token cache is being invalidate because project 606d2e3572dd48c6b8cd005da1254e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:15.070400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.071600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.073749 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1333/2647] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:14 2022] DELETE /identity/v3/projects/606d2e3572dd48c6b8cd005da1254e37 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:15.077726 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:15.088189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9a172-bc5b-4bc7-a644-8d66495394d4 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:15.148087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:15.148961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:15.149257 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:15.149536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] PATH_INFO: `/v3/users/045aecd0bf9149eabe47974d9692d94a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:15.151351 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] RBAC: Authorizing `identity:delete_user(user_id=045aecd0bf9149eabe47974d9692d94a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:15.153341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:15.174611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:15.333561 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045aecd0bf9149eabe47974d9692d94a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.395582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045aecd0bf9149eabe47974d9692d94a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.396227 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045aecd0bf9149eabe47974d9692d94a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.396841 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045aecd0bf9149eabe47974d9692d94a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.404331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045aecd0bf9149eabe47974d9692d94a'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:15.421537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1315/2648] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:15 2022] DELETE /identity/v3/users/045aecd0bf9149eabe47974d9692d94a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:15.855337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:15.857045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:15.873496 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980f7c-e98b-4584-9b67-c025c847860d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:15.923528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:15.933194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:15.938838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:15.938838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:15.938838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] PATH_INFO: `/v3/projects/c10a9d371baa40f29ea1de79c1c619a6` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:15.938838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10a9d371baa40f29ea1de79c1c619a6)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:15.938838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:16.047429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10a9d371baa40f29ea1de79c1c619a6', 'request_id': 'req-48d14abd-9ce0-4d68-b2da-f70643fcbb23'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.098224 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10a9d371baa40f29ea1de79c1c619a6', 'request_id': 'req-48d14abd-9ce0-4d68-b2da-f70643fcbb23'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.105161 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10a9d371baa40f29ea1de79c1c619a6', 'request_id': 'req-48d14abd-9ce0-4d68-b2da-f70643fcbb23'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.116253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] The token cache is being invalidate because project c10a9d371baa40f29ea1de79c1c619a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:16.116543 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.117175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.119277 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1334/2649] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:15 2022] DELETE /identity/v3/projects/c10a9d371baa40f29ea1de79c1c619a6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:16.123499 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:16.125010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:16.138342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde9d7-707d-421a-bcb5-819c6cae754d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:16.195033 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:16.195911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:16.196352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:16.196633 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] PATH_INFO: `/v3/users/a3ec279f9997496bbeea117041f64078` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:16.197919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ec279f9997496bbeea117041f64078)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:16.199845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:16.420719 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ec279f9997496bbeea117041f64078'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.486976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ec279f9997496bbeea117041f64078'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.487615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ec279f9997496bbeea117041f64078'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.488272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ec279f9997496bbeea117041f64078'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.496092 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-739c6804-13c6-4fa4-baed-d870c0434ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ec279f9997496bbeea117041f64078'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:16.514133 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1316/2650] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:16 2022] DELETE /identity/v3/users/a3ec279f9997496bbeea117041f64078 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:16.934500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:16.936399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:16.952067 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d14abd-9ce0-4d68-b2da-f70643fcbb23 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.010529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.011401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.011685 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.011963 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] PATH_INFO: `/v3/projects/3db0083576a24e51b475390d487d2be4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.013180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db0083576a24e51b475390d487d2be4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.015108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.120429 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db0083576a24e51b475390d487d2be4', 'request_id': 'req-4470a548-8e8a-484b-8a20-468f3d13a11f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:17.193936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db0083576a24e51b475390d487d2be4', 'request_id': 'req-4470a548-8e8a-484b-8a20-468f3d13a11f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:17.200600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db0083576a24e51b475390d487d2be4', 'request_id': 'req-4470a548-8e8a-484b-8a20-468f3d13a11f'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:17.211928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] The token cache is being invalidate because project 3db0083576a24e51b475390d487d2be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:17.212191 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:17.213335 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4470a548-8e8a-484b-8a20-468f3d13a11f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:17.214915 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1335/2651] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:16 2022] DELETE /identity/v3/projects/3db0083576a24e51b475390d487d2be4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:17.221185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.221673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.221773 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.241286 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:17.242494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:17.254764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:17.300365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1317/2652] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:54:17.309802 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.310089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.310369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.328855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:17.330057 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:17.338540 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1336/2653] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:17.342771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:17.352959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a5a6-5d02-4a81-9976-aa6474af1b51 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.357558 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.359428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.359428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.359428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.359428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:54:17.359801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.361401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.372878 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1318/2654] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:54:17.377073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:17.387014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264654f-f644-4e39-b40f-78c86c5a9231 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.391663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.392339 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.392620 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.392892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.393678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.395610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.398791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:17.534298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1337/2655] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:17 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:17.538455 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:17.548658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7a63-0e23-414f-a027-9df864ff8c59 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.605687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.606352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.606636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.606909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.607602 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.609505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.704551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1319/2656] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:17 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:17.708763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:17.719172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce9f5-158d-4226-ab2b-28afd5e3f9a0 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.724031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.724715 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.725000 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.725276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.726021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.727613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.737846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1338/2657] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:17.741859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:17.752301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c91432-a156-4a16-b81a-668f2d6ef0c6 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.756905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876a0f-b6ac-42fc-803f-75d7892392b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.757557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876a0f-b6ac-42fc-803f-75d7892392b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.757842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876a0f-b6ac-42fc-803f-75d7892392b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.758122 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876a0f-b6ac-42fc-803f-75d7892392b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.758842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5876a0f-b6ac-42fc-803f-75d7892392b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.761115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5876a0f-b6ac-42fc-803f-75d7892392b6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.770919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1320/2658] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:17.774964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:17.784944 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aade585-e768-4d00-9a9c-661699498676 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:17.789494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:17.790417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.790684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.790957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] PATH_INFO: `/v3/projects/46e23ab250dd44fdb7d0fd2cf58cc7a8/users/8552dbab681347949e9f4a399563d143/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.805961 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e23ab250dd44fdb7d0fd2cf58cc7a8, user_id=8552dbab681347949e9f4a399563d143, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:17.809663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:17.873851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1339/2659] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:17 2022] PUT /identity/v3/projects/46e23ab250dd44fdb7d0fd2cf58cc7a8/users/8552dbab681347949e9f4a399563d143/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:17.885550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:17.885842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:17.886124 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:17.913151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] MFA Rules not processed for user `8552dbab681347949e9f4a399563d143`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:17.914363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:17.979444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1321/2660] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:17.984212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.046857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374157-c2cf-4213-be15-43a941a09747 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.051594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.054337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.054337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.054337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.054337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.055405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.140150 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1340/2661] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:17 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:18.144458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.157011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00d7bc-0443-4302-b79f-4320f6570cf9 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.167084 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:18.216936 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.217619 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.218113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.218448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.219423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.222064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.315268 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1322/2662] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:18 2022] POST /identity/v3/users => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:18.319477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.329943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187196e-1344-464e-9093-82cbf73acd3e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.334503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.335158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.335441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.335714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.336464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.338139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.348847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1341/2663] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:18.353532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.363732 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0202b1-0f40-4299-9d7a-c64d81889599 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.368410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.369943 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.370223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.370501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] PATH_INFO: `/v3/projects/cc46901d019d438e8b048662d0f5463e/users/d812a8c647d346448bc4abbe380a907b/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.385126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc46901d019d438e8b048662d0f5463e, user_id=d812a8c647d346448bc4abbe380a907b, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.387767 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.452317 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1323/2664] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:18 2022] PUT /identity/v3/projects/cc46901d019d438e8b048662d0f5463e/users/d812a8c647d346448bc4abbe380a907b/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:18.456272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.466839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911bae3-7069-4cb9-9c1c-54b9b10364c9 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.523291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8a031-cbfa-4b88-938e-cb88e3be1768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.523946 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8a031-cbfa-4b88-938e-cb88e3be1768 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.524252 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8a031-cbfa-4b88-938e-cb88e3be1768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.524526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8a031-cbfa-4b88-938e-cb88e3be1768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.525785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8a031-cbfa-4b88-938e-cb88e3be1768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.527404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8a031-cbfa-4b88-938e-cb88e3be1768 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.537121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1342/2665] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:18.542028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.552559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31c120-98ec-4316-8b56-8fa69dc43440 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.557205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.558088 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.558370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.558646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] PATH_INFO: `/v3/projects/cc46901d019d438e8b048662d0f5463e/users/d812a8c647d346448bc4abbe380a907b/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.560755 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc46901d019d438e8b048662d0f5463e, user_id=d812a8c647d346448bc4abbe380a907b, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.563414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.579914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1324/2666] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:18 2022] PUT /identity/v3/projects/cc46901d019d438e8b048662d0f5463e/users/d812a8c647d346448bc4abbe380a907b/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:54:18.590099 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.590392 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.590671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.618054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] MFA Rules not processed for user `d812a8c647d346448bc4abbe380a907b`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:18.619321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:18.627156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:18.685986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1343/2667] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:18.697518 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.699195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:18.757944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b11c-13d5-4928-a518-49ef12d05c88 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.762382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.763028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.763314 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.763595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.772576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.773996 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.783550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1325/2668] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:18.829317 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:18.830741 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:18.843149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d86f8-3d1f-407b-8e86-4ee526e8378f None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:18.846997 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1b04e-fa34-41ee-92b4-ef33a6d29599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:18.847631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b04e-fa34-41ee-92b4-ef33a6d29599 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:18.847907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b04e-fa34-41ee-92b4-ef33a6d29599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:18.848209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b04e-fa34-41ee-92b4-ef33a6d29599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:18.904632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1b04e-fa34-41ee-92b4-ef33a6d29599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:18.906068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1b04e-fa34-41ee-92b4-ef33a6d29599 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:18.914787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1344/2669] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:23.551882 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:23.617780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b26d1-54e8-4154-a559-5af3f7512e14 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:23.623150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:23.624024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:23.624341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:23.624617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] PATH_INFO: `/v3/users/8552dbab681347949e9f4a399563d143` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:23.625799 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8552dbab681347949e9f4a399563d143)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:23.627695 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:23.638009 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:23.830941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8552dbab681347949e9f4a399563d143'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:23.925025 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8552dbab681347949e9f4a399563d143'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:23.925652 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8552dbab681347949e9f4a399563d143'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:23.926282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8552dbab681347949e9f4a399563d143'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:23.934037 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8552dbab681347949e9f4a399563d143'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:23.952952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1326/2670] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:23 2022] DELETE /identity/v3/users/8552dbab681347949e9f4a399563d143 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:23.957442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:23.957884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:23.958139 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:23.975477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:23.979195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:24.035861 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1345/2671] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:24.045954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:24.047329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:24.108725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bd1c7-a65b-4359-a628-a90ba27fa159 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:24.112522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:24.113191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:24.113473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:24.113749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:24.123111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:24.124757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:24.135125 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1327/2672] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:24.574630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:24.576703 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:24.588748 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd592b-8f32-4958-b505-c6b3cd7069ac None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:24.593389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:24.594290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:24.594574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:24.594848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] PATH_INFO: `/v3/projects/46e23ab250dd44fdb7d0fd2cf58cc7a8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:24.596331 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e23ab250dd44fdb7d0fd2cf58cc7a8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:24.599757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:24.709767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:24.716847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e23ab250dd44fdb7d0fd2cf58cc7a8', 'request_id': 'req-17898891-7008-4d75-b7f4-ca367a434e52'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:24.818342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e23ab250dd44fdb7d0fd2cf58cc7a8', 'request_id': 'req-17898891-7008-4d75-b7f4-ca367a434e52'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:24.824217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e23ab250dd44fdb7d0fd2cf58cc7a8', 'request_id': 'req-17898891-7008-4d75-b7f4-ca367a434e52'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:24.834868 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] The token cache is being invalidate because project 46e23ab250dd44fdb7d0fd2cf58cc7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:24.835176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:24.835875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:24.838140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1346/2673] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:24 2022] DELETE /identity/v3/projects/46e23ab250dd44fdb7d0fd2cf58cc7a8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:24.842136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:24.853338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9f824-9439-4408-aa49-3cd2553f9e32 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:24.919117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:24.920169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:24.920311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:24.920594 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] PATH_INFO: `/v3/users/d812a8c647d346448bc4abbe380a907b` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:24.921911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d812a8c647d346448bc4abbe380a907b)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:24.923947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:25.054288 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:25.066834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd812a8c647d346448bc4abbe380a907b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.125217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd812a8c647d346448bc4abbe380a907b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.125833 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd812a8c647d346448bc4abbe380a907b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.126426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd812a8c647d346448bc4abbe380a907b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.135623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b8cf5c45-6c23-4ae6-aada-592725b8b10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd812a8c647d346448bc4abbe380a907b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.154716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1328/2674] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:24 2022] DELETE /identity/v3/users/d812a8c647d346448bc4abbe380a907b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:25.591442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:25.593013 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:25.607338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17898891-7008-4d75-b7f4-ca367a434e52 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:25.663523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:25.664415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:25.664693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:25.665023 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] PATH_INFO: `/v3/projects/cc46901d019d438e8b048662d0f5463e` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:25.666226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc46901d019d438e8b048662d0f5463e)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:25.668172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:25.802037 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc46901d019d438e8b048662d0f5463e', 'request_id': 'req-97b204e9-e295-47f2-9202-0da8a95cfbe6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.862226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc46901d019d438e8b048662d0f5463e', 'request_id': 'req-97b204e9-e295-47f2-9202-0da8a95cfbe6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.869928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc46901d019d438e8b048662d0f5463e', 'request_id': 'req-97b204e9-e295-47f2-9202-0da8a95cfbe6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.880217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] The token cache is being invalidate because project cc46901d019d438e8b048662d0f5463e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:25.880500 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.881160 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-97b204e9-e295-47f2-9202-0da8a95cfbe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:25.882719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1347/2675] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:25 2022] DELETE /identity/v3/projects/cc46901d019d438e8b048662d0f5463e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:25.888241 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:25.888712 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:25.888811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:25.906971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:25.908948 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:25.968390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1329/2676] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:25.977547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:25.977847 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:25.978167 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:25.998434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:25.999653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:26.007754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1348/2677] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:26.012769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.022320 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dae84-f3bf-4262-b1ca-1768b4924c3c None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.026913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.027557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.027838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.028150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.028864 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:54:26.029165 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.030728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.043446 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1330/2678] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:54:26.047282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.057121 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851f795-719c-4c53-b9f8-25d05c495315 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.061726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.062405 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.062684 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.062950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.063637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.065563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.157848 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1349/2679] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:26 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:26.162425 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.173002 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16eeb0-3b4c-4b13-b22f-30ab1688cdb9 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.231716 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.232434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.232722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.232999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.233684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.235579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.349462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1331/2680] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:26 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:26.354459 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.364572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481ebe3-3556-4760-81e5-60ce642d450e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.370290 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.370952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.371233 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.371506 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.372322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.373927 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.384633 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1350/2681] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:26.388668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.398374 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23b452-03a7-437a-b92f-387937e49757 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.402988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3d5a8-cc42-44e3-a5df-14b982effe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.403628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3d5a8-cc42-44e3-a5df-14b982effe89 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.403910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3d5a8-cc42-44e3-a5df-14b982effe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.404235 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3d5a8-cc42-44e3-a5df-14b982effe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.404947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3d5a8-cc42-44e3-a5df-14b982effe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.406516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3d5a8-cc42-44e3-a5df-14b982effe89 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.416784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1332/2682] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:26.420853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.430755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69005430-97d3-481a-abd1-9be45696cf24 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.436451 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.437316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.437601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.437878 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] PATH_INFO: `/v3/projects/cbebeece37b04e8599c337c8fdbbb9db/users/a089800f54cf48e186e64bf9a7accaf5/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.452832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbebeece37b04e8599c337c8fdbbb9db, user_id=a089800f54cf48e186e64bf9a7accaf5, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.455488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.457836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:26.538246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1351/2683] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:26 2022] PUT /identity/v3/projects/cbebeece37b04e8599c337c8fdbbb9db/users/a089800f54cf48e186e64bf9a7accaf5/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:26.550161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.550457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.554769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.577486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] MFA Rules not processed for user `a089800f54cf48e186e64bf9a7accaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:26.578699 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:26.582702 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:26.642598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1333/2684] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:26.646951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.708420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc70bb-6c67-419c-90fa-bbc97eb7033d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.713608 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.714256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.714539 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.714808 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.715477 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.717400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.823549 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1352/2685] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:26 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:26.827560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.839793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d0bd-8d36-4ecb-a05f-90da695c9c38 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:26.896841 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:26.897516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:26.897694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:26.897967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:26.898693 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:26.901215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:26.983750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1334/2686] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:26 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:54:26.987501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:26.998185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0104ce-2ab5-4c60-8b02-77d7b951997a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.003155 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.003824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.004134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.004412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.005134 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.006719 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.021010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1353/2687] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:27.022356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.033742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d109-1dd1-4a48-a552-b6e1da328a9f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.038453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a3da-1476-47a8-a92a-671fc29a34b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.039109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a3da-1476-47a8-a92a-671fc29a34b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.039395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a3da-1476-47a8-a92a-671fc29a34b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.039678 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a3da-1476-47a8-a92a-671fc29a34b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.040978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a3da-1476-47a8-a92a-671fc29a34b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.042593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a3da-1476-47a8-a92a-671fc29a34b0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.052730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1335/2688] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:27.057387 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.067252 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d08484-d994-4258-9831-2120cbb33dff admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.072487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.073352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.073632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.073905 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] PATH_INFO: `/v3/projects/f02f2e36e7f04dc1b83a278b229a9be8/users/2dededbb18d4483e8c2d5e09cadc4979/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.088853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02f2e36e7f04dc1b83a278b229a9be8, user_id=2dededbb18d4483e8c2d5e09cadc4979, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.091523 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.173244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1354/2689] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:27 2022] PUT /identity/v3/projects/f02f2e36e7f04dc1b83a278b229a9be8/users/2dededbb18d4483e8c2d5e09cadc4979/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:54:27.184546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.184836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.185229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.211660 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] MFA Rules not processed for user `2dededbb18d4483e8c2d5e09cadc4979`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:27.213539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:27.285749 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1336/2690] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:27.287158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.357594 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39b758-1da4-4a07-b197-d09a5aa708ab admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.364537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.365332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.365619 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.365899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.366628 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.369169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.470218 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1355/2691] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:27 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:54:27.474395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.485894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9e2ac-db0a-4dbc-aaae-ccf77deb64d4 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.494789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:27.543142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.544008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.544379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.547665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.547665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.547665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.658526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1337/2692] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:27 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:27.662516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.673557 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a3b3-5cda-4793-adf1-c7d6667bf9f7 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.678101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.678759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.679041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.679346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.680388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.682157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.692750 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1356/2693] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:27.696897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.706856 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2f1c-a417-455b-82e7-4b2f9efa6a7f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.711458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.712926 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.713210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.713486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] PATH_INFO: `/v3/projects/c3426446292e42959a733c29312c91d7/users/e0c6fea5c1ea4a7088f5c3ea8eb9e5a2/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.729051 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3426446292e42959a733c29312c91d7, user_id=e0c6fea5c1ea4a7088f5c3ea8eb9e5a2, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.731621 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.835402 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1338/2694] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:27 2022] PUT /identity/v3/projects/c3426446292e42959a733c29312c91d7/users/e0c6fea5c1ea4a7088f5c3ea8eb9e5a2/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:27.840045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.850217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7330aa4-ea03-48dc-9c8c-eae4c15b8ca2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.862204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:27.907650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f18e4-bb29-42c4-b0f8-2db2b8af4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.908343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f18e4-bb29-42c4-b0f8-2db2b8af4db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.908624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f18e4-bb29-42c4-b0f8-2db2b8af4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.908895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f18e4-bb29-42c4-b0f8-2db2b8af4db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.909602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f18e4-bb29-42c4-b0f8-2db2b8af4db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.911185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f18e4-bb29-42c4-b0f8-2db2b8af4db5 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.920875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1357/2695] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:27.925128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:27.935530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03b3b3-fe8e-4386-b7d2-78f22d7cccd1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:27.940221 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:27.941160 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.941445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.941724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] PATH_INFO: `/v3/projects/c3426446292e42959a733c29312c91d7/users/e0c6fea5c1ea4a7088f5c3ea8eb9e5a2/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.943707 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3426446292e42959a733c29312c91d7, user_id=e0c6fea5c1ea4a7088f5c3ea8eb9e5a2, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:27.946881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:27.957111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1339/2696] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:27 2022] PUT /identity/v3/projects/c3426446292e42959a733c29312c91d7/users/e0c6fea5c1ea4a7088f5c3ea8eb9e5a2/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:27.968266 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:27.968556 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:27.968855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:27.995253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] MFA Rules not processed for user `e0c6fea5c1ea4a7088f5c3ea8eb9e5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:27.996450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:28.065046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1358/2697] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:54:28.076220 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:28.077991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:28.136696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062df9d3-7ffb-4dad-8ad5-455abab4b695 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:28.140508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:28.141156 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:28.141444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:28.141720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:28.151951 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:28.153413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:28.163331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1340/2698] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:28.263647 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:28.265048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:28.277536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4100-c3e5-42da-9cad-bee69a86cc45 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:28.281118 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2a79-dfab-4d63-bada-d2870f9b4e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:28.281782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2a79-dfab-4d63-bada-d2870f9b4e66 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:28.282059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2a79-dfab-4d63-bada-d2870f9b4e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:28.282338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2a79-dfab-4d63-bada-d2870f9b4e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:28.337866 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2a79-dfab-4d63-bada-d2870f9b4e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:28.339316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2a79-dfab-4d63-bada-d2870f9b4e66 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:28.348590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1359/2699] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:32.594828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:32.658967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350b8a-fc56-46d3-bd65-218980993714 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:32.663910 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:32.665532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:32.665817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:32.666155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] PATH_INFO: `/v3/users/a089800f54cf48e186e64bf9a7accaf5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:32.667326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a089800f54cf48e186e64bf9a7accaf5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:32.669282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:32.682990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:32.904937 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a089800f54cf48e186e64bf9a7accaf5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:32.983855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a089800f54cf48e186e64bf9a7accaf5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:32.984508 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a089800f54cf48e186e64bf9a7accaf5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:32.985115 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a089800f54cf48e186e64bf9a7accaf5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:32.994208 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a089800f54cf48e186e64bf9a7accaf5'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:33.013202 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1341/2700] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:32 2022] DELETE /identity/v3/users/a089800f54cf48e186e64bf9a7accaf5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:33.017716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:33.018226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:33.018360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:33.035244 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:33.036488 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:33.072850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:33.113482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1360/2701] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:33.124973 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:33.126428 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:33.187189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c1144-db95-4a04-ac29-10b5114d7fbf admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:33.190838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341614a-5b4a-4c4e-ba6b-af34662f67be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:33.191494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341614a-5b4a-4c4e-ba6b-af34662f67be service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:33.191924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341614a-5b4a-4c4e-ba6b-af34662f67be service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:33.192233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341614a-5b4a-4c4e-ba6b-af34662f67be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:33.201947 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341614a-5b4a-4c4e-ba6b-af34662f67be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:33.203421 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341614a-5b4a-4c4e-ba6b-af34662f67be service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:33.214173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1342/2702] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:33.820003 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:33.821412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:33.833756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ab6e7-9e39-4173-803b-93fa7b2a5b79 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:33.838780 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:33.839674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:33.839960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:33.840263 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] PATH_INFO: `/v3/projects/cbebeece37b04e8599c337c8fdbbb9db` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:33.841487 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbebeece37b04e8599c337c8fdbbb9db)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:33.843457 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:33.993873 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbebeece37b04e8599c337c8fdbbb9db', 'request_id': 'req-a935bc30-42b3-4557-90b3-6a40a8539ac2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.081077 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:34.081624 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:34.081727 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:34.100182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] MFA Rules not processed for user `e50a12d7facd4e4184d79bbac03bfa74`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:34.101432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:34.120860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbebeece37b04e8599c337c8fdbbb9db', 'request_id': 'req-a935bc30-42b3-4557-90b3-6a40a8539ac2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.129128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbebeece37b04e8599c337c8fdbbb9db', 'request_id': 'req-a935bc30-42b3-4557-90b3-6a40a8539ac2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.142041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] The token cache is being invalidate because project cbebeece37b04e8599c337c8fdbbb9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:34.142346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.143015 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.144781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1361/2703] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:33 2022] DELETE /identity/v3/projects/cbebeece37b04e8599c337c8fdbbb9db => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:34.148640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:34.151091 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:34.168343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1343/2704] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:54:34.220256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935bc30-42b3-4557-90b3-6a40a8539ac2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:34.225667 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:34.226575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:34.226856 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:34.227781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] PATH_INFO: `/v3/users/2dededbb18d4483e8c2d5e09cadc4979` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:34.229044 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dededbb18d4483e8c2d5e09cadc4979)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:34.230949 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:34.445083 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dededbb18d4483e8c2d5e09cadc4979'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.445874 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dededbb18d4483e8c2d5e09cadc4979'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.565318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dededbb18d4483e8c2d5e09cadc4979'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.566119 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dededbb18d4483e8c2d5e09cadc4979'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.575542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dededbb18d4483e8c2d5e09cadc4979'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:34.577092 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:34.596726 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1362/2705] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:34 2022] DELETE /identity/v3/users/2dededbb18d4483e8c2d5e09cadc4979 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:54:35.300784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:35.311994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e295c-f40b-4ead-99ef-7fc84644f253 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:35.353145 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:35.376713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:35.377577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:35.377855 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:35.378128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] PATH_INFO: `/v3/projects/f02f2e36e7f04dc1b83a278b229a9be8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:35.379318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02f2e36e7f04dc1b83a278b229a9be8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:35.381246 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:35.538473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02f2e36e7f04dc1b83a278b229a9be8', 'request_id': 'req-bfd36d03-db31-4697-8962-0a7cdd19c144'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:35.544770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02f2e36e7f04dc1b83a278b229a9be8', 'request_id': 'req-bfd36d03-db31-4697-8962-0a7cdd19c144'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:35.658053 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02f2e36e7f04dc1b83a278b229a9be8', 'request_id': 'req-bfd36d03-db31-4697-8962-0a7cdd19c144'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:35.670169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] The token cache is being invalidate because project f02f2e36e7f04dc1b83a278b229a9be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:35.670453 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:35.671131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:35.672728 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1344/2706] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:35 2022] DELETE /identity/v3/projects/f02f2e36e7f04dc1b83a278b229a9be8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:35.676827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:35.678268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:35.692220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22113-081c-49bc-b6ff-25eb3f4a0a7a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:35.750108 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:35.750988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:35.751268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:35.751550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] PATH_INFO: `/v3/users/e0c6fea5c1ea4a7088f5c3ea8eb9e5a2` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:35.752743 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c6fea5c1ea4a7088f5c3ea8eb9e5a2)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:35.754671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:36.107395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c6fea5c1ea4a7088f5c3ea8eb9e5a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:36.108228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c6fea5c1ea4a7088f5c3ea8eb9e5a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:36.251757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c6fea5c1ea4a7088f5c3ea8eb9e5a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:36.251757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c6fea5c1ea4a7088f5c3ea8eb9e5a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:36.269330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-9a53db1e-13de-4be0-ab79-2c55c8522f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c6fea5c1ea4a7088f5c3ea8eb9e5a2'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:36.291771 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1363/2707] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:35 2022] DELETE /identity/v3/users/e0c6fea5c1ea4a7088f5c3ea8eb9e5a2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:36.778659 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:36.780159 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:36.794410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36d03-db31-4697-8962-0a7cdd19c144 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:36.851661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:36.853127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:36.853405 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:36.853677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] PATH_INFO: `/v3/projects/c3426446292e42959a733c29312c91d7` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:36.854857 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3426446292e42959a733c29312c91d7)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:36.856776 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:36.995722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3426446292e42959a733c29312c91d7', 'request_id': 'req-64bdb9b0-0d75-466b-8269-02070f5309f6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:37.001837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3426446292e42959a733c29312c91d7', 'request_id': 'req-64bdb9b0-0d75-466b-8269-02070f5309f6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:37.080475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3426446292e42959a733c29312c91d7', 'request_id': 'req-64bdb9b0-0d75-466b-8269-02070f5309f6'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:37.085797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:37.095798 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] The token cache is being invalidate because project c3426446292e42959a733c29312c91d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:37.096213 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:37.097347 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-64bdb9b0-0d75-466b-8269-02070f5309f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:37.099153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1345/2708] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:36 2022] DELETE /identity/v3/projects/c3426446292e42959a733c29312c91d7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:37.105849 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.106348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.106450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.124545 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:37.125746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:37.184375 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:37.202460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1364/2709] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:37.204343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.204753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.205135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.231041 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:37.232302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:37.244035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1346/2710] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:37.248897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:37.257431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8a46-37e9-4be6-a086-7d61b0610ad3 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:37.263699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:37.263891 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.264194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.264580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.265308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:54:37.265613 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:37.267204 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:37.284364 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1365/2711] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:54:37.292439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:37.302297 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d2233-4ad5-4f4d-a705-602e084ad88f None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:37.308219 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:37.308989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.309274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.309553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.310734 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:37.312380 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:37.455273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1347/2712] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:37 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:54:37.459245 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:37.475645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0c552-c9a8-47f4-9663-af6a2161848d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:37.548098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:37.548098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.548098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.548098 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.548449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:37.548449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:37.743617 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1366/2713] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:37 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:54:37.747416 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:37.758238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d365286-fba3-42ca-93ea-a07dea1c9819 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:37.763148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:37.763828 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.764151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.764427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.765411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:37.767106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:37.782158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1348/2714] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:37.783508 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:37.794901 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db57f6-7d99-4598-81b7-814703590a17 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:37.799834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b906867-3a1a-49d4-b752-4fdef4fbf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:37.803409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906867-3a1a-49d4-b752-4fdef4fbf171 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.803409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906867-3a1a-49d4-b752-4fdef4fbf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.803409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906867-3a1a-49d4-b752-4fdef4fbf171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.803409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b906867-3a1a-49d4-b752-4fdef4fbf171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:37.803409 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b906867-3a1a-49d4-b752-4fdef4fbf171 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:37.815236 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1367/2715] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:54:37.819139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:37.829784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3eb96-7b14-48a8-9bf9-2d7b5d148fae admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:37.834506 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:37.835398 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.835688 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.835968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] PATH_INFO: `/v3/projects/e0d243a1abbb44e9bca2d312f1dae9f2/users/6358d7c26dfb474f991fed0cc09316f7/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.851760 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d243a1abbb44e9bca2d312f1dae9f2, user_id=6358d7c26dfb474f991fed0cc09316f7, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:37.855028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:37.944505 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1349/2716] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:37 2022] PUT /identity/v3/projects/e0d243a1abbb44e9bca2d312f1dae9f2/users/6358d7c26dfb474f991fed0cc09316f7/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:54:37.957142 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:37.957440 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:37.958111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:37.986729 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] MFA Rules not processed for user `6358d7c26dfb474f991fed0cc09316f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:37.988021 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:38.053691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1368/2717] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:38.068679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:38.070553 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:38.141444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d7686-7b26-4199-b556-9bb7e41ca3cb admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:38.146287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:38.147081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:38.147410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:38.147800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:38.162316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:38.163835 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:38.178148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1350/2718] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:45.737147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:45.738547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:45.811691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:45.831284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db12b-1c26-432f-b0d7-292a4ebdfd04 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:45.841691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:45.841691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:45.841691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:45.841691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:45.842248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:45.854306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:45.855903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551d079-0dcf-415d-96ff-06f9cef3b747 service placement] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:45.865939 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1369/2719] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:48.170535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:48.527395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:48.594147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d971-ca2f-4111-9f59-76f2084316f9 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:48.599105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:48.599994 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:48.600342 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:48.600753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] PATH_INFO: `/v3/users/6358d7c26dfb474f991fed0cc09316f7` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:48.602917 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6358d7c26dfb474f991fed0cc09316f7)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:48.610761 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:48.850081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6358d7c26dfb474f991fed0cc09316f7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:48.913922 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6358d7c26dfb474f991fed0cc09316f7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:48.914890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6358d7c26dfb474f991fed0cc09316f7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:48.915651 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6358d7c26dfb474f991fed0cc09316f7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:48.924496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6358d7c26dfb474f991fed0cc09316f7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:48.945615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1351/2720] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:54:48 2022] DELETE /identity/v3/users/6358d7c26dfb474f991fed0cc09316f7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:54:48.950456 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:48.950955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:48.951078 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:48.969356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:48.970833 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:49.044214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1370/2721] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:54:49.058956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:49.061162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:49.130450 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ba3c-aade-4420-9543-0821e1ee03d1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:49.137839 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbda41-ee6e-4095-a92e-d4ef5a005866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:49.138552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbda41-ee6e-4095-a92e-d4ef5a005866 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:49.138844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbda41-ee6e-4095-a92e-d4ef5a005866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:49.139126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbda41-ee6e-4095-a92e-d4ef5a005866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:49.151921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbda41-ee6e-4095-a92e-d4ef5a005866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:49.153415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbda41-ee6e-4095-a92e-d4ef5a005866 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:49.164481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1352/2722] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:49.773664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:49.775188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:49.787200 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905222c-d150-4432-9ec8-85bac10b74c8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:49.799948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:49.801009 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:49.801376 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:49.801766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] PATH_INFO: `/v3/projects/e0d243a1abbb44e9bca2d312f1dae9f2` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:49.803068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d243a1abbb44e9bca2d312f1dae9f2)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:49.805850 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:49.915166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d243a1abbb44e9bca2d312f1dae9f2', 'request_id': 'req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:49.989270 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d243a1abbb44e9bca2d312f1dae9f2', 'request_id': 'req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:49.997635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d243a1abbb44e9bca2d312f1dae9f2', 'request_id': 'req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:50.010179 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] The token cache is being invalidate because project e0d243a1abbb44e9bca2d312f1dae9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:54:50.010438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:50.011796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-34c4a5c1-6797-4fa5-9e9f-e92509a6a5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:54:50.013621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1371/2723] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:54:49 2022] DELETE /identity/v3/projects/e0d243a1abbb44e9bca2d312f1dae9f2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:50.019134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.020089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.020610 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.041635 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:50.042854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:50.067029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:50.114903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1353/2724] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:50.123460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.123752 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.124028 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.143929 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:50.145182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:50.154991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1372/2725] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:54:50.159070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.169647 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78be9d-827e-4ad1-840c-b3d6af02a50d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.174495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.175226 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.175513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.175796 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.176560 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:54:50.176870 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.178513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.191329 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1354/2726] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:54:50.195950 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.205890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf52069-af9e-4eb9-bee7-2cb8ce2c53d4 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.211611 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.212336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.212603 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.212875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.213575 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.215481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.305560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1373/2727] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:54:50 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:54:50.309851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.320724 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066bb18-011b-4b49-93a8-30c2389b2cc8 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.379211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.379894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.380222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.380503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.381209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.383954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.459456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1355/2728] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:54:50 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:54:50.462695 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.473836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c37dc-0f48-41b5-a487-ef75689ba9d7 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.479437 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.480157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.480656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.480809 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.481542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.483210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.496497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1374/2729] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:50.500628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.511989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc7d5-ea0f-4d4f-8b2d-7280771baacd admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.517008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad6272-f935-4361-a4c7-d3b18a9fa6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.517694 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad6272-f935-4361-a4c7-d3b18a9fa6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.518019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad6272-f935-4361-a4c7-d3b18a9fa6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.518300 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad6272-f935-4361-a4c7-d3b18a9fa6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.519085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad6272-f935-4361-a4c7-d3b18a9fa6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.520752 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad6272-f935-4361-a4c7-d3b18a9fa6c6 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.532911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1356/2730] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:54:50.537235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.548165 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1df4-2921-4ac5-9f5e-2400fc4f7a64 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.559453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.560425 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.560722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.566337 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] PATH_INFO: `/v3/projects/b53d8ce8920c4eb886b75eff075c4404/users/8e9e7271524e4bc69fa4e8c198ba0af2/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.581770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53d8ce8920c4eb886b75eff075c4404, user_id=8e9e7271524e4bc69fa4e8c198ba0af2, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.584391 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.710742 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1375/2731] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:54:50 2022] PUT /identity/v3/projects/b53d8ce8920c4eb886b75eff075c4404/users/8e9e7271524e4bc69fa4e8c198ba0af2/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:54:50.715956 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1637d-f55d-4b43-9339-2f7087784b43 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.716292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1637d-f55d-4b43-9339-2f7087784b43 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.716622 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1637d-f55d-4b43-9339-2f7087784b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.735352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-f4c1637d-f55d-4b43-9339-2f7087784b43 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:50.736591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-f4c1637d-f55d-4b43-9339-2f7087784b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:50.821595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1357/2732] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:54:50.834484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:50.836663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:50.844158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:50.897449 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145f44-56db-45e6-a77a-5f35d21ec299 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:50.901843 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:50.902514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:50.902792 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:50.903069 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:50.916448 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:50.917966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:50.927992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1376/2733] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:52.338940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463431c-fa0f-48fd-b5d3-3c132cedba6d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:52.339579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463431c-fa0f-48fd-b5d3-3c132cedba6d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:52.339579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463431c-fa0f-48fd-b5d3-3c132cedba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:52.367713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-7463431c-fa0f-48fd-b5d3-3c132cedba6d None None] MFA Rules not processed for user `8e9e7271524e4bc69fa4e8c198ba0af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:52.368965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-7463431c-fa0f-48fd-b5d3-3c132cedba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:52.386774 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:52.435015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1358/2734] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:54:52.445711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:54:52.450286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:52.504502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca25ef5-ca92-4305-86cb-08479f3e1954 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:54:52.508731 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca96d-49b5-4634-a0bf-98b6d1065729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:54:52.509373 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca96d-49b5-4634-a0bf-98b6d1065729 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:52.509652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca96d-49b5-4634-a0bf-98b6d1065729 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:52.510074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca96d-49b5-4634-a0bf-98b6d1065729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:52.522264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ca96d-49b5-4634-a0bf-98b6d1065729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:54:52.524571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ca96d-49b5-4634-a0bf-98b6d1065729 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:54:52.533503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1377/2735] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:54:54.295617 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:54:54.296382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:54:54.296382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:54:54.315067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] MFA Rules not processed for user `8e9e7271524e4bc69fa4e8c198ba0af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:54:54.316306 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:54:54.323668 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1359/2736] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:55:02.529524 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=50 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:04.309750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=22 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:12.698379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870cbe-ba1c-450f-8140-7bf00315d163 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:12.698907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870cbe-ba1c-450f-8140-7bf00315d163 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:12.698907 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870cbe-ba1c-450f-8140-7bf00315d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:12.716358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-a8870cbe-ba1c-450f-8140-7bf00315d163 None None] MFA Rules not processed for user `8e9e7271524e4bc69fa4e8c198ba0af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:55:12.717552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-a8870cbe-ba1c-450f-8140-7bf00315d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:55:12.724738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1378/2737] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:55:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:55:12.949528 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:55:12.959266 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaa581-9c90-444b-81f8-9e1cc98162d6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:55:12.962904 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:55:12.963577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:12.963860 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:12.964233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:12.965999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:55:12.976423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:55:12.977845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:55:12.985880 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1360/2738] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:55:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:55:22.711347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:22.982318 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=6 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:36.003713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43369a4-ac9b-49b5-8ea0-5c349558acb6 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:36.014738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43369a4-ac9b-49b5-8ea0-5c349558acb6 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:36.014738 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43369a4-ac9b-49b5-8ea0-5c349558acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:36.023355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-c43369a4-ac9b-49b5-8ea0-5c349558acb6 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:55:36.024662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c43369a4-ac9b-49b5-8ea0-5c349558acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:55:36.082060 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1379/2739] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:55:36.226589 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:55:36.227998 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:55:36.297873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaba21-1273-4883-ba81-e6e7685f8aae service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:55:36.302848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8743d2-1616-4456-a794-c5ba6de96f1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:55:36.303500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8743d2-1616-4456-a794-c5ba6de96f1a service swift] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:36.303782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8743d2-1616-4456-a794-c5ba6de96f1a service swift] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:36.304072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8743d2-1616-4456-a794-c5ba6de96f1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:36.312591 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8743d2-1616-4456-a794-c5ba6de96f1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:55:36.314170 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8743d2-1616-4456-a794-c5ba6de96f1a service swift] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:55:36.322961 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1361/2740] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:55:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 13:55:45.827931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:45.828560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:45.828658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:45.869434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] MFA Rules not processed for user `e50a12d7facd4e4184d79bbac03bfa74`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:55:45.870986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:55:45.944182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1380/2741] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:55:46.318968 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=32 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:53.826541 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:53.827142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:53.827142 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:53.845293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:55:53.846494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:55:53.854611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1362/2742] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 8 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:55:53.867368 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:55:53.879552 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6a5d4-3ef6-4e07-abf8-6fbb49f112fa None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:55:53.885237 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:55:53.885888 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:53.886168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:53.886442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:53.895216 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:55:53.896884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:55:53.906066 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1381/2743] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:55:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:55:57.197827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:55:57.197827 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8210e4-b065-46f5-b6de-f7fd7124d192 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:55:57.198642 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:55:57.199023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:57.199302 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:57.199576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] PATH_INFO: `/v3/users/8e9e7271524e4bc69fa4e8c198ba0af2` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:57.200744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9e7271524e4bc69fa4e8c198ba0af2)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:55:57.202914 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:55:57.509764 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9e7271524e4bc69fa4e8c198ba0af2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:57.620757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9e7271524e4bc69fa4e8c198ba0af2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:57.621373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9e7271524e4bc69fa4e8c198ba0af2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:57.621976 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9e7271524e4bc69fa4e8c198ba0af2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:57.629564 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9e7271524e4bc69fa4e8c198ba0af2'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:57.648806 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1363/2744] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:55:57 2022] DELETE /identity/v3/users/8e9e7271524e4bc69fa4e8c198ba0af2 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:55:57.953821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:55:57.966577 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8f932-2024-4b8a-b4c3-98059660a802 service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:55:58.025483 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:55:58.026344 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:55:58.026621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:55:58.026889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] PATH_INFO: `/v3/projects/b53d8ce8920c4eb886b75eff075c4404` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:55:58.028075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53d8ce8920c4eb886b75eff075c4404)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:55:58.029986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:55:58.169527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:58.176480 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53d8ce8920c4eb886b75eff075c4404', 'request_id': 'req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:58.271302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53d8ce8920c4eb886b75eff075c4404', 'request_id': 'req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:58.278011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53d8ce8920c4eb886b75eff075c4404', 'request_id': 'req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:58.290318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] The token cache is being invalidate because project b53d8ce8920c4eb886b75eff075c4404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:55:58.290755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:58.291616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:55:58.293501 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1382/2745] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:55:57 2022] DELETE /identity/v3/projects/b53d8ce8920c4eb886b75eff075c4404 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:56:07.644931 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:08.408338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:20.028809 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:20.030279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:20.100952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1226c-29b1-48b4-af9c-4d5b5ad5a482 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:20.157139 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:20.157813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:20.158083 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:20.158361 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:20.160192 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:20.224813 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:20.226473 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:20.236738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1364/2746] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:56:22.461516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:22.462980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:22.477128 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6dfcb-2066-4ffb-9da1-4afb972d1f81 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:22.482106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:22.483226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:22.483513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:22.483793 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] PATH_INFO: `/v3/users/24e3c65a8b344e4e893c3ebf436ac660` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:22.485089 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e3c65a8b344e4e893c3ebf436ac660)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:22.487104 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:22.674928 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e3c65a8b344e4e893c3ebf436ac660'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:22.675623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e3c65a8b344e4e893c3ebf436ac660'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:22.791860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e3c65a8b344e4e893c3ebf436ac660'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:22.792567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e3c65a8b344e4e893c3ebf436ac660'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:22.800137 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e3c65a8b344e4e893c3ebf436ac660'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:22.818065 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1383/2747] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:56:22 2022] DELETE /identity/v3/users/24e3c65a8b344e4e893c3ebf436ac660 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:56:23.091585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:23.096697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eef356-12c5-4722-a9d8-38edd551a0e9 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:23.155014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:23.155907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:23.156234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:23.156514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] PATH_INFO: `/v3/projects/708bec67bbb748b382b82cd0da768d5c` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:23.157704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] RBAC: Authorizing `identity:delete_project(project_id=708bec67bbb748b382b82cd0da768d5c)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:23.159648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:23.168665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:23.300671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708bec67bbb748b382b82cd0da768d5c', 'request_id': 'req-a205f03d-45b7-4ad8-b276-192851ca741b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.307335 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708bec67bbb748b382b82cd0da768d5c', 'request_id': 'req-a205f03d-45b7-4ad8-b276-192851ca741b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.380209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708bec67bbb748b382b82cd0da768d5c', 'request_id': 'req-a205f03d-45b7-4ad8-b276-192851ca741b'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.391629 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] The token cache is being invalidate because project 708bec67bbb748b382b82cd0da768d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:56:23.391919 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.392574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.394151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1365/2748] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:56:23 2022] DELETE /identity/v3/projects/708bec67bbb748b382b82cd0da768d5c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:56:23.398965 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:23.404176 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:23.413642 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15df38-65f5-49ce-aa32-eef21fe881b2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:23.470992 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:23.471867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:23.472186 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:23.472467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] PATH_INFO: `/v3/users/2d6991eda046471f9fa3965bd1e32b01` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:23.473745 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6991eda046471f9fa3965bd1e32b01)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:23.476047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:23.737631 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6991eda046471f9fa3965bd1e32b01'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.738246 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6991eda046471f9fa3965bd1e32b01'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.820884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6991eda046471f9fa3965bd1e32b01'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.821511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6991eda046471f9fa3965bd1e32b01'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.828906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6991eda046471f9fa3965bd1e32b01'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:23.836686 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:23.847332 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1384/2749] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:56:23 2022] DELETE /identity/v3/users/2d6991eda046471f9fa3965bd1e32b01 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:56:24.090991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:24.092556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:24.107454 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205f03d-45b7-4ad8-b276-192851ca741b admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:24.166341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:24.167209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:24.167493 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:24.167770 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] PATH_INFO: `/v3/projects/57fc05095ad8465dbef7b7d35be6b200` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:24.168980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fc05095ad8465dbef7b7d35be6b200)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:24.170859 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:24.312232 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fc05095ad8465dbef7b7d35be6b200', 'request_id': 'req-eeaf2787-f74e-4185-83c8-51ee13e77d62'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:24.318274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fc05095ad8465dbef7b7d35be6b200', 'request_id': 'req-eeaf2787-f74e-4185-83c8-51ee13e77d62'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:24.403265 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fc05095ad8465dbef7b7d35be6b200', 'request_id': 'req-eeaf2787-f74e-4185-83c8-51ee13e77d62'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:24.414748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] The token cache is being invalidate because project 57fc05095ad8465dbef7b7d35be6b200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:56:24.415031 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:24.416830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:56:24.417182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1366/2750] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:56:24 2022] DELETE /identity/v3/projects/57fc05095ad8465dbef7b7d35be6b200 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:56:34.118796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:34.410944 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:40.790212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:40.791625 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:40.848300 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36bd8e-c300-4027-ae7b-fc47d5c2ad41 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:40.895105 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:40.895680 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:40.895962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:40.896269 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:40.898019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:40.968512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:40.969972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f342f5-2e02-43cf-aaeb-178bab14f08d service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:40.981181 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1385/2751] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:56:41.144769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:41.146308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:41.158658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf2787-f74e-4185-83c8-51ee13e77d62 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:41.162228 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:41.162868 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:41.163153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:41.163432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:41.165175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:41.178464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:41.179902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:41.191445 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1367/2752] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:56:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:56:50.976977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:50.977503 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=74 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:50.977943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:50.978292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:50.996522 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] MFA Rules not processed for user `e50a12d7facd4e4184d79bbac03bfa74`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:56:50.997697 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:51.051763 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1386/2753] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:56:51.186580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=6 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:54.599512 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:56:54.601061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:54.659309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2140f-d41d-40ea-a682-bc859eea7fad service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:56:54.663079 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:56:54.663757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:56:54.664043 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:56:54.664353 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:56:54.666109 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:56:54.676072 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:56:54.677500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:56:54.685706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1368/2754] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:56:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:57:01.089212 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=25 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:04.682106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=26 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:53.182543 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:57:53.183996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:57:53.202398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03260ac7-9266-4ac4-b9c8-1d4e376b8ef7 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:57:53.208689 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:57:53.209659 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:57:53.221149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:57:53.221407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:57:53.233045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:57:53.249059 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:57:53.259126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:57:53.264330 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1387/2755] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:57:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:58:03.101607 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:03.103223 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:03.174272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253007-1bfd-4b7e-b4a0-48293fa3c601 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:03.179162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:03.179836 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:03.180153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:03.180431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:03.184765 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:03.196357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:03.197909 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:03.208276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1369/2756] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:58:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:58:03.239560 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:03.241954 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:03.308240 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1525-60a2-4796-ba67-611adf004010 service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:03.313042 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:03.313914 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:03.314198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:03.314475 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] PATH_INFO: `/v3/users/e50a12d7facd4e4184d79bbac03bfa74` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:03.315724 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50a12d7facd4e4184d79bbac03bfa74)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:03.317616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:03.543054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50a12d7facd4e4184d79bbac03bfa74'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:03.543711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50a12d7facd4e4184d79bbac03bfa74'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:03.631482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50a12d7facd4e4184d79bbac03bfa74'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:03.632126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50a12d7facd4e4184d79bbac03bfa74'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:03.640404 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c38db501-1b07-48d4-b826-e4475354e271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50a12d7facd4e4184d79bbac03bfa74'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:03.657497 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1388/2757] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:58:03 2022] DELETE /identity/v3/users/e50a12d7facd4e4184d79bbac03bfa74 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:03.913217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:03.924887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b843323-2b7a-4671-a5d6-03b84c16e2b1 service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:03.986730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:03.988087 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:03.989073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:03.989793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] PATH_INFO: `/v3/projects/9015bc58fb5948a9bbc41ef874faede5` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:03.991596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9015bc58fb5948a9bbc41ef874faede5)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:03.993666 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.163876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9015bc58fb5948a9bbc41ef874faede5', 'request_id': 'req-b665c0a3-9edd-4299-83a2-606e0fcb9309'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:04.170689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9015bc58fb5948a9bbc41ef874faede5', 'request_id': 'req-b665c0a3-9edd-4299-83a2-606e0fcb9309'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:04.254794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9015bc58fb5948a9bbc41ef874faede5', 'request_id': 'req-b665c0a3-9edd-4299-83a2-606e0fcb9309'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:04.265989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] The token cache is being invalidate because project 9015bc58fb5948a9bbc41ef874faede5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:58:04.266283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:04.266928 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-b665c0a3-9edd-4299-83a2-606e0fcb9309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:04.268542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1370/2758] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:58:03 2022] DELETE /identity/v3/projects/9015bc58fb5948a9bbc41ef874faede5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:04.273418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.273898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.274019 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.294086 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:04.295282 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:04.356561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1389/2759] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:04.364263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.364557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.364838 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.383154 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:04.384376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:04.392750 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1371/2760] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:04.396828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:04.408486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6f8a6-2d7d-4c3f-9661-4967b5641ab2 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:04.413281 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:04.413989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.414219 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.414494 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.415208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:58:04.415513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:04.417182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.419547 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:04.430435 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1390/2761] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:58:04.435577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:04.444413 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0e3a-8c02-45dd-b03b-0dd5309b9ce7 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:04.449471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:04.450128 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.450414 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.450697 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.451403 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:04.453348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.463348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:04.542188 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1372/2762] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:58:04 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:58:04.547080 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:04.557101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8339b-3670-4895-b641-daef3f9a2e00 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:04.614034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:04.614711 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.614991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.615267 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.615960 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:04.617909 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.741353 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1391/2763] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:58:04 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:04.745465 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:04.755837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715dbb-0100-4b86-9ea3-a1e5ff89f92f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:04.760598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:04.761720 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.762050 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.762327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.763058 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:04.764688 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.775218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1373/2764] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:04.779853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:04.789881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14430b4-4dcd-4285-bca2-3858d509c1a3 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:04.794639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a21836-40e2-4d72-995e-2eea54ffff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:04.795292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a21836-40e2-4d72-995e-2eea54ffff47 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.795576 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a21836-40e2-4d72-995e-2eea54ffff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.795846 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a21836-40e2-4d72-995e-2eea54ffff47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.796600 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a21836-40e2-4d72-995e-2eea54ffff47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:04.798235 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a21836-40e2-4d72-995e-2eea54ffff47 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.808321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1392/2765] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:04.812304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:04.822477 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f580a0-cf22-40c1-9d9c-9cd6351ce078 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:04.828222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:04.829136 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.829441 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.829723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] PATH_INFO: `/v3/projects/76b4ab40330c4e0884a397c6e5d7153f/users/a91b40b193774ddf8e7a0d3fa3e48db0/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.846491 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b4ab40330c4e0884a397c6e5d7153f, user_id=a91b40b193774ddf8e7a0d3fa3e48db0, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:04.849435 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:04.929222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1374/2766] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:58:04 2022] PUT /identity/v3/projects/76b4ab40330c4e0884a397c6e5d7153f/users/a91b40b193774ddf8e7a0d3fa3e48db0/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:04.938265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f904d1-d5b4-4b69-969f-fedb793a0596 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:04.938265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f904d1-d5b4-4b69-969f-fedb793a0596 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:04.938265 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f904d1-d5b4-4b69-969f-fedb793a0596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:04.954855 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f7f904d1-d5b4-4b69-969f-fedb793a0596 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:04.956211 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f7f904d1-d5b4-4b69-969f-fedb793a0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:05.016046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1393/2767] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:05.025443 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:05.027915 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:05.084149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04f1c5-ac35-427c-9e15-04d5198f409e admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:05.087794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:05.088464 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:05.088747 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:05.089021 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:05.098905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:05.100430 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:05.110418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1375/2768] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:58:06.660683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:06.661209 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:06.661312 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:06.690326 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] MFA Rules not processed for user `a91b40b193774ddf8e7a0d3fa3e48db0`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:06.695412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:06.758821 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1394/2769] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:06.763991 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:06.773897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49498-1075-452a-9a0b-bff15b10d827 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:06.778879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:06.779537 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:06.779826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:06.780191 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:06.780887 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:06.782790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:06.913598 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1376/2770] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:58:06 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:06.919071 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:06.924615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:06.930413 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03839-ff1c-40d6-b8e9-278a1aca3487 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:06.987825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:06.988526 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:06.988807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:06.989081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:06.989764 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:06.991688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:07.113257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1395/2771] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:58:06 2022] POST /identity/v3/users => generated 309 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:07.117217 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:07.128177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc87d31-bba1-4e4d-a8e1-6040fb2af0e2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:07.132920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:07.133638 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:07.133939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:07.134199 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:07.135029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:07.137121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:07.148338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1377/2772] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:07.152502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:07.164700 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7bd20-8dbf-43c5-9f3e-0740d482902a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:07.170632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:07.171555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:07.171851 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:07.172162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] PATH_INFO: `/v3/projects/dbac4e938435444c86933a8bfe7a1fdd/users/476a7bc4664944f1aaa7bb7e1f0dffc7/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:07.188257 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbac4e938435444c86933a8bfe7a1fdd, user_id=476a7bc4664944f1aaa7bb7e1f0dffc7, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:07.193166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:07.266825 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1396/2773] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:58:07 2022] PUT /identity/v3/projects/dbac4e938435444c86933a8bfe7a1fdd/users/476a7bc4664944f1aaa7bb7e1f0dffc7/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:07.270842 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:07.281418 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ee00b-91ee-484b-8903-3c8f5227a0fe admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:07.336756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03622-1a9f-4931-96f6-c846e47a99d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:07.337431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03622-1a9f-4931-96f6-c846e47a99d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:07.337744 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03622-1a9f-4931-96f6-c846e47a99d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:07.338024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03622-1a9f-4931-96f6-c846e47a99d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:07.338743 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03622-1a9f-4931-96f6-c846e47a99d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:07.341256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03622-1a9f-4931-96f6-c846e47a99d2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:07.351522 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1378/2774] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:07.356527 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:07.366842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e3c53-b64e-42d8-a716-40f69f672f3a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:07.371785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:07.372706 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:07.372988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:07.373264 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] PATH_INFO: `/v3/projects/dbac4e938435444c86933a8bfe7a1fdd/users/476a7bc4664944f1aaa7bb7e1f0dffc7/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:07.375307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbac4e938435444c86933a8bfe7a1fdd, user_id=476a7bc4664944f1aaa7bb7e1f0dffc7, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:07.377995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:07.388427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1397/2775] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:58:07 2022] PUT /identity/v3/projects/dbac4e938435444c86933a8bfe7a1fdd/users/476a7bc4664944f1aaa7bb7e1f0dffc7/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:08.815615 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:08.816391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:08.816391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:08.847038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] MFA Rules not processed for user `476a7bc4664944f1aaa7bb7e1f0dffc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:08.848581 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:08.859169 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:08.919613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1379/2776] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:10.443794 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:10.507826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdfb0f-e98e-47ce-a665-bd26600e7f8a admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:10.512446 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:10.513321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:10.513626 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:10.513902 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] PATH_INFO: `/v3/users/a91b40b193774ddf8e7a0d3fa3e48db0` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:10.515110 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91b40b193774ddf8e7a0d3fa3e48db0)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:10.517106 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:10.690466 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91b40b193774ddf8e7a0d3fa3e48db0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:10.691115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91b40b193774ddf8e7a0d3fa3e48db0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:10.785966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91b40b193774ddf8e7a0d3fa3e48db0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:10.786550 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91b40b193774ddf8e7a0d3fa3e48db0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:10.788804 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:10.794153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91b40b193774ddf8e7a0d3fa3e48db0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:10.811377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1398/2777] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:58:10 2022] DELETE /identity/v3/users/a91b40b193774ddf8e7a0d3fa3e48db0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:11.056064 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:11.069830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f9e4-8c61-49ba-ae0f-ee8cddd6a81c None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:11.135154 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:11.136680 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:11.136962 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:11.137236 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] PATH_INFO: `/v3/projects/76b4ab40330c4e0884a397c6e5d7153f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:11.138423 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b4ab40330c4e0884a397c6e5d7153f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:11.140365 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:11.260551 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b4ab40330c4e0884a397c6e5d7153f', 'request_id': 'req-13de7a88-1baf-4e82-8d1f-1513968978e4'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.267255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b4ab40330c4e0884a397c6e5d7153f', 'request_id': 'req-13de7a88-1baf-4e82-8d1f-1513968978e4'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.328664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b4ab40330c4e0884a397c6e5d7153f', 'request_id': 'req-13de7a88-1baf-4e82-8d1f-1513968978e4'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.339823 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] The token cache is being invalidate because project 76b4ab40330c4e0884a397c6e5d7153f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:58:11.340150 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.340775 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.342458 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1380/2778] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:58:11 2022] DELETE /identity/v3/projects/76b4ab40330c4e0884a397c6e5d7153f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:11.346599 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:11.348292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:11.361114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b445de-8a94-48ea-b3a6-d65d167a54d4 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:11.418744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:11.419627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:11.419913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:11.420238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] PATH_INFO: `/v3/users/476a7bc4664944f1aaa7bb7e1f0dffc7` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:11.421426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476a7bc4664944f1aaa7bb7e1f0dffc7)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:11.423388 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:11.623948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476a7bc4664944f1aaa7bb7e1f0dffc7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.624585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476a7bc4664944f1aaa7bb7e1f0dffc7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.722751 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476a7bc4664944f1aaa7bb7e1f0dffc7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.723652 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476a7bc4664944f1aaa7bb7e1f0dffc7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.731450 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4b143d3a-d4e1-48ab-ad3f-ee4f626da355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476a7bc4664944f1aaa7bb7e1f0dffc7'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:11.749058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1399/2779] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:58:11 2022] DELETE /identity/v3/users/476a7bc4664944f1aaa7bb7e1f0dffc7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:12.016299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.017872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:12.032080 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7a88-1baf-4e82-8d1f-1513968978e4 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.066655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:12.089411 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.090346 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.090618 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.090888 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] PATH_INFO: `/v3/projects/dbac4e938435444c86933a8bfe7a1fdd` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.092117 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbac4e938435444c86933a8bfe7a1fdd)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:12.094112 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:12.272404 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbac4e938435444c86933a8bfe7a1fdd', 'request_id': 'req-f5603bff-ae89-4b69-93a6-94025ca619cc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:12.279212 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbac4e938435444c86933a8bfe7a1fdd', 'request_id': 'req-f5603bff-ae89-4b69-93a6-94025ca619cc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:12.397438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbac4e938435444c86933a8bfe7a1fdd', 'request_id': 'req-f5603bff-ae89-4b69-93a6-94025ca619cc'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:12.408988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] The token cache is being invalidate because project dbac4e938435444c86933a8bfe7a1fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:58:12.409279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:12.409921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-f5603bff-ae89-4b69-93a6-94025ca619cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:58:12.411468 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1381/2780] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:58:12 2022] DELETE /identity/v3/projects/dbac4e938435444c86933a8bfe7a1fdd => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:58:12.416407 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.416696 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.416975 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.434691 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:12.435887 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:12.490390 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:12.502699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1400/2781] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:12.512349 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.512639 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.512920 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.533120 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:12.535035 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:12.543355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1382/2782] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:12.551966 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.563770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9782d-4520-4ba5-9236-4b13dc372f0d None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.568682 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.569570 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.570238 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.570636 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.571399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:58:12.571713 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:12.574027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:12.589145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1401/2783] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:58:12.593523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.603008 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c537af-59f2-40bc-ba09-38abc4d11771 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.607795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.608486 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.608768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.609036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.609725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:12.611597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:12.726704 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1383/2784] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:58:12 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:12.731573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.741807 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7f27-0dc6-4225-bab7-f00df776240c admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.800170 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.800756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.801033 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.801304 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.801983 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:12.803897 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:12.892427 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1402/2785] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:58:12 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:12.896531 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.907284 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbae1f-db95-441b-8481-19db84450017 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.912123 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.912780 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.913067 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.913343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.914062 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:12.915646 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:12.928665 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1384/2786] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:12.932829 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.943947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd585-50f7-48d7-ac3a-1797c5bbfed8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.948651 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a962d-3327-4f3b-a1c5-e890ba6cca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.949310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a962d-3327-4f3b-a1c5-e890ba6cca30 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.949597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a962d-3327-4f3b-a1c5-e890ba6cca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.949869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a962d-3327-4f3b-a1c5-e890ba6cca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:12.950589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a962d-3327-4f3b-a1c5-e890ba6cca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:12.952251 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a962d-3327-4f3b-a1c5-e890ba6cca30 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:12.962718 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1403/2787] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:12.967432 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:12.982756 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ade6b-64f4-4b94-9a73-249a1277b9ba admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:12.987570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:12.988497 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:12.988782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:12.989061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] PATH_INFO: `/v3/projects/03d0f5eb27fb4e62b3b46e1889608f4d/users/eada5418a73d4e728ecadc6e42099d5a/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:13.006781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d0f5eb27fb4e62b3b46e1889608f4d, user_id=eada5418a73d4e728ecadc6e42099d5a, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:13.009456 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:13.238143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1385/2788] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:58:12 2022] PUT /identity/v3/projects/03d0f5eb27fb4e62b3b46e1889608f4d/users/eada5418a73d4e728ecadc6e42099d5a/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:13.249068 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:13.249367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:13.249650 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:13.276076 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] MFA Rules not processed for user `eada5418a73d4e728ecadc6e42099d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:13.277791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:13.341528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1404/2789] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:13.346343 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:13.408263 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89a32-113e-40cf-bc39-79c03e70474d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:13.412814 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:13.413475 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:13.413905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:13.414200 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:13.414885 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:13.416811 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:13.426019 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:13.553348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1386/2790] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:58:13 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:13.557470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:13.568445 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c63af-ff85-4f5f-bbdf-9b7ef2ee1b37 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:13.625156 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:13.637227 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:13.638443 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:13.638964 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:13.639481 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:13.640814 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:13.644262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:13.763699 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1405/2791] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:58:13 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:58:13.767784 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:13.779623 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cca0d8-f509-4e35-9525-78b74569efa1 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:13.784350 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:13.785014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:13.785303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:13.785583 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:13.786310 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:13.787897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:13.799285 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1387/2792] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 13:58:13.803538 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:13.813768 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02cfa7-417e-4c54-81dc-8f69d4383d69 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:13.818352 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:13.819343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:13.819627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:13.819903 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] PATH_INFO: `/v3/projects/1972fffe2713487e94da239b65fedc8a/users/4fcae100e9824028bb67045a08745aab/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:13.835062 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1972fffe2713487e94da239b65fedc8a, user_id=4fcae100e9824028bb67045a08745aab, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:13.837754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:13.928881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1406/2793] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:58:13 2022] PUT /identity/v3/projects/1972fffe2713487e94da239b65fedc8a/users/4fcae100e9824028bb67045a08745aab/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:13.933376 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:13.943247 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225096c6-0891-4ff3-a072-e5e2b34ed178 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:13.999304 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ff868-69f9-49b5-90b7-2cf1db46ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:13.999965 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff868-69f9-49b5-90b7-2cf1db46ef18 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:14.000281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff868-69f9-49b5-90b7-2cf1db46ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:14.000559 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff868-69f9-49b5-90b7-2cf1db46ef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:14.001272 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ff868-69f9-49b5-90b7-2cf1db46ef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:14.002879 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ff868-69f9-49b5-90b7-2cf1db46ef18 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:14.013334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1388/2794] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:58:14.017453 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:14.028346 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961671-575b-4473-b1d6-f1e0fb76ac34 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:14.032936 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:14.033822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:14.034116 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:14.034367 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] PATH_INFO: `/v3/projects/1972fffe2713487e94da239b65fedc8a/users/4fcae100e9824028bb67045a08745aab/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:14.036366 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1972fffe2713487e94da239b65fedc8a, user_id=4fcae100e9824028bb67045a08745aab, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:14.039073 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:14.049510 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1407/2795] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:58:14 2022] PUT /identity/v3/projects/1972fffe2713487e94da239b65fedc8a/users/4fcae100e9824028bb67045a08745aab/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:58:14.060011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:14.060352 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:14.060675 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:14.087113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] MFA Rules not processed for user `4fcae100e9824028bb67045a08745aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:58:14.088356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:14.160532 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1389/2796] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:58:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:58:14.177048 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:14.178769 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:58:14.236189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef857-4ee7-42b8-9677-cd1e2a6de64b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:14.239585 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:14.240285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:14.240564 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:14.240835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:14.250416 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:14.251839 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:14.261803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1408/2797] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:58:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 13:58:14.530218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:58:14.540158 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e09c0-aa83-4ea3-8d50-b31e350d632e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:58:14.544644 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f9563-21be-4992-90e4-c1b0ebcf2a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:58:14.545281 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f9563-21be-4992-90e4-c1b0ebcf2a32 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:58:14.545574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f9563-21be-4992-90e4-c1b0ebcf2a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:58:14.545854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f9563-21be-4992-90e4-c1b0ebcf2a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:58:14.602373 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f9563-21be-4992-90e4-c1b0ebcf2a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:58:14.603805 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f9563-21be-4992-90e4-c1b0ebcf2a32 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:58:14.608106 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:14.614011 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1390/2798] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:58:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:58:24.256953 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:58:24.900215 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:03.206374 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:03.312164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1d8e-fc2d-43ba-acb0-61341b3b4319 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:03.317058 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:03.317930 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:03.318217 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:03.318533 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] PATH_INFO: `/v3/users/eada5418a73d4e728ecadc6e42099d5a` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:03.320426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=eada5418a73d4e728ecadc6e42099d5a)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:03.322410 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:03.600434 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eada5418a73d4e728ecadc6e42099d5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:03.601301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eada5418a73d4e728ecadc6e42099d5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:03.705761 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eada5418a73d4e728ecadc6e42099d5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:03.706399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eada5418a73d4e728ecadc6e42099d5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:03.713785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eada5418a73d4e728ecadc6e42099d5a'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:03.731881 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1409/2799] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:59:03 2022] DELETE /identity/v3/users/eada5418a73d4e728ecadc6e42099d5a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:03.736611 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:03.737121 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:03.737233 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:03.785356 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:03.786542 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:03.843932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1391/2800] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:03.855601 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:03.857046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:03.903415 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:03.959382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb952-8abe-4b37-8761-d200ef3ca4ba admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:03.963325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:03.963977 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:03.964293 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:03.964569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:03.973765 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:03.975462 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:03.985467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1410/2801] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:04.530683 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:04.532161 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:04.546790 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ca20-0e26-4d64-bb10-7a3e71c98dcb None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:04.550269 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:04.551131 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:04.551412 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:04.551689 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] PATH_INFO: `/v3/projects/03d0f5eb27fb4e62b3b46e1889608f4d` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:04.552912 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d0f5eb27fb4e62b3b46e1889608f4d)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:04.554883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:04.667851 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d0f5eb27fb4e62b3b46e1889608f4d', 'request_id': 'req-9c2215d2-71da-4e94-8af6-46b1c57b5540'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:04.674052 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d0f5eb27fb4e62b3b46e1889608f4d', 'request_id': 'req-9c2215d2-71da-4e94-8af6-46b1c57b5540'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:04.757574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d0f5eb27fb4e62b3b46e1889608f4d', 'request_id': 'req-9c2215d2-71da-4e94-8af6-46b1c57b5540'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:04.768858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] The token cache is being invalidate because project 03d0f5eb27fb4e62b3b46e1889608f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:59:04.769148 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:04.769808 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:04.771399 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1392/2802] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:59:04 2022] DELETE /identity/v3/projects/03d0f5eb27fb4e62b3b46e1889608f4d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:04.776403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:04.786338 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b4bf7-8874-4fc5-97db-1ad020454cd5 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:04.843393 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:04.844310 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:04.844597 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:04.844871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] PATH_INFO: `/v3/users/4fcae100e9824028bb67045a08745aab` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:04.846047 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcae100e9824028bb67045a08745aab)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:04.847981 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:05.161458 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcae100e9824028bb67045a08745aab'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:05.162169 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcae100e9824028bb67045a08745aab'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:05.271399 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcae100e9824028bb67045a08745aab'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:05.272029 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcae100e9824028bb67045a08745aab'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:05.279898 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-0f922fbd-6007-4776-baea-ab5ca42b31bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcae100e9824028bb67045a08745aab'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:05.297994 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1411/2803] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:59:04 2022] DELETE /identity/v3/users/4fcae100e9824028bb67045a08745aab => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:05.770311 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:05.771801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:05.785183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2215d2-71da-4e94-8af6-46b1c57b5540 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:05.838339 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:05.844525 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:05.845392 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:05.845677 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:05.845954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] PATH_INFO: `/v3/projects/1972fffe2713487e94da239b65fedc8a` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:05.847174 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1972fffe2713487e94da239b65fedc8a)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:05.849474 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:05.991959 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1972fffe2713487e94da239b65fedc8a', 'request_id': 'req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:05.998023 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1972fffe2713487e94da239b65fedc8a', 'request_id': 'req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:06.089001 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1972fffe2713487e94da239b65fedc8a', 'request_id': 'req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:06.100417 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] The token cache is being invalidate because project 1972fffe2713487e94da239b65fedc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:59:06.103110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:06.103110 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-d6622b69-a4ab-4eaa-a9a0-e48d02c48b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:06.103643 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1393/2804] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:59:05 2022] DELETE /identity/v3/projects/1972fffe2713487e94da239b65fedc8a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:06.109842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.110770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.110770 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.144744 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:06.161090 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:06.162369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:06.222032 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1412/2805] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:59:06.230858 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.231147 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.231433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.250462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:06.252151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:06.260238 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1394/2806] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:06.264428 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:06.274660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afd453-8c68-48fc-9d8f-be76ae6ccaa1 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:06.279322 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:06.279979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.280299 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.280579 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.281321 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:59:06.281630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:06.283243 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:06.295189 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1413/2807] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 13:59:06.299183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:06.309328 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a58b-9af6-4129-b967-0967c1eb4e12 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:06.314036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:06.314691 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.314978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.315256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.316004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:06.318101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:06.444168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1395/2808] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:59:06 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:06.449178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:06.459026 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8b600-3d20-495d-b400-5bddff854bdc admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:06.522152 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:06.523343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.523624 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.523895 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.524623 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:06.526531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:06.643511 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1414/2809] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:59:06 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:59:06.648444 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:06.658696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dc857-4acb-4490-a7fd-c4106fb55930 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:06.663216 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:06.663964 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.664273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.664613 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.665337 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:06.667177 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:06.677205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1396/2810] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:06.681830 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:06.691683 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd999d2-0009-4460-a54b-6ec66f2a769e admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:06.697040 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3ec7-d29e-4ee7-a64b-a6287a764f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:06.697688 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3ec7-d29e-4ee7-a64b-a6287a764f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.698008 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3ec7-d29e-4ee7-a64b-a6287a764f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.698302 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3ec7-d29e-4ee7-a64b-a6287a764f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.699081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3ec7-d29e-4ee7-a64b-a6287a764f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:06.700717 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f3ec7-d29e-4ee7-a64b-a6287a764f67 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:06.710674 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1415/2811] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:06.714663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:06.724714 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5a7cf-2258-4bdc-b91d-794ba700ae7c admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:06.729748 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:06.730616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.730898 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.731196 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] PATH_INFO: `/v3/projects/68cb09a2b8f04b24aa66a09279a4318b/users/149400e68e8c4d88bc227fda17a21da0/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.746022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cb09a2b8f04b24aa66a09279a4318b, user_id=149400e68e8c4d88bc227fda17a21da0, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:06.748648 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:06.837515 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1397/2812] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:06 2022] PUT /identity/v3/projects/68cb09a2b8f04b24aa66a09279a4318b/users/149400e68e8c4d88bc227fda17a21da0/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:59:06.847889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:06.848241 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:06.848525 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:06.876133 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] MFA Rules not processed for user `149400e68e8c4d88bc227fda17a21da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:06.877342 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:06.933286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:06.942054 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1416/2813] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:06.947387 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.009940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582955a-150b-421f-a3ea-88f2c6d1c9f0 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.014781 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.015447 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.015723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.016000 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.016725 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.018690 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.158826 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1398/2814] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:59:06 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:07.163574 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.174341 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37540b74-2738-4e02-9580-554bdac3dc52 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.229670 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.230389 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.230678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.230952 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.231641 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.233627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.334372 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1417/2815] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:59:07 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:07.338370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.356355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749b892-eea0-4099-96f9-d4b7caa191de admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.356355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.356355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.356355 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.356803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.356803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.358038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.360195 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:07.369897 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1399/2816] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:07.373947 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.383762 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc6d6-d3e4-4aee-8f24-647cdaffde29 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.388272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.389138 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.389424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.396555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] PATH_INFO: `/v3/projects/7498349ad6104cc480e6036edc1c26d8/users/ca4163e5758440babc57f93495f61fc6/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.404923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7498349ad6104cc480e6036edc1c26d8, user_id=ca4163e5758440babc57f93495f61fc6, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.407567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.541985 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1418/2817] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:07 2022] PUT /identity/v3/projects/7498349ad6104cc480e6036edc1c26d8/users/ca4163e5758440babc57f93495f61fc6/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:07.546358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.556309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf526-d236-43f0-a1ec-4aef31ba460d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.612105 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e424-28eb-4e3d-9bb6-d9805ad13c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.612758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e424-28eb-4e3d-9bb6-d9805ad13c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.613107 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e424-28eb-4e3d-9bb6-d9805ad13c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.613395 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e424-28eb-4e3d-9bb6-d9805ad13c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.614113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e424-28eb-4e3d-9bb6-d9805ad13c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.615730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e424-28eb-4e3d-9bb6-d9805ad13c09 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.625575 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1400/2818] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:07.629400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.639582 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2441a-b016-42f0-b5d5-58fa15dcd2ff admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.644175 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.645050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.645334 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.645610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] PATH_INFO: `/v3/projects/7498349ad6104cc480e6036edc1c26d8/users/ca4163e5758440babc57f93495f61fc6/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.648115 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7498349ad6104cc480e6036edc1c26d8, user_id=ca4163e5758440babc57f93495f61fc6, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.650978 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.661097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1419/2819] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:07 2022] PUT /identity/v3/projects/7498349ad6104cc480e6036edc1c26d8/users/ca4163e5758440babc57f93495f61fc6/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:07.723030 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.723319 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.723601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.751501 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] MFA Rules not processed for user `ca4163e5758440babc57f93495f61fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:07.752740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:07.820022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1401/2820] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:07.831607 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:07.833301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:07.890432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334da4f-b530-4718-b45e-e80866b428a2 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:07.893996 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:07.894640 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:07.894923 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:07.895201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:07.904785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:07.906226 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:07.915842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1420/2821] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:08.057162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:08.067162 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73caec3-0ce4-486a-9b7d-d406f047563e None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:08.071521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504643-58aa-4967-89fe-1253e52bf9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:08.072206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504643-58aa-4967-89fe-1253e52bf9ba service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:08.072494 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504643-58aa-4967-89fe-1253e52bf9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:08.072787 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504643-58aa-4967-89fe-1253e52bf9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:08.134028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504643-58aa-4967-89fe-1253e52bf9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:08.135469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504643-58aa-4967-89fe-1253e52bf9ba service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:08.144730 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1402/2822] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:08.619111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:08.670569 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:08.683010 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc286e8-8901-4fcf-924b-65377c791b45 service cinder] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:08.687756 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:08.696207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:08.696207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:08.696207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] PATH_INFO: `/v3/users/149400e68e8c4d88bc227fda17a21da0` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:08.696207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=149400e68e8c4d88bc227fda17a21da0)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:08.696207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:08.908572 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149400e68e8c4d88bc227fda17a21da0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:08.909205 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149400e68e8c4d88bc227fda17a21da0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.003261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149400e68e8c4d88bc227fda17a21da0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.003826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149400e68e8c4d88bc227fda17a21da0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.012140 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149400e68e8c4d88bc227fda17a21da0'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.031014 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1421/2823] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:59:08 2022] DELETE /identity/v3/users/149400e68e8c4d88bc227fda17a21da0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:09.035630 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:09.035921 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:09.036239 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:09.055149 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:09.056438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:09.068462 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=100 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:09.119877 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1403/2824] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:09.129605 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:09.130986 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:09.189896 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604f5e-3be4-4370-a3c1-9942ce1aa92d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:09.193447 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:09.194123 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:09.194816 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:09.194948 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:09.204114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:09.205551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:09.215495 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1422/2825] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:09.644366 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:09.645800 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:09.658984 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff7f8-be3d-4452-87ca-82b6e5307d8b None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:09.664845 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:09.665891 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:09.666186 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:09.666471 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] PATH_INFO: `/v3/projects/68cb09a2b8f04b24aa66a09279a4318b` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:09.667700 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68cb09a2b8f04b24aa66a09279a4318b)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:09.669679 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:09.814102 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68cb09a2b8f04b24aa66a09279a4318b', 'request_id': 'req-573189c1-62d2-4949-b440-096eceb86774'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.820293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68cb09a2b8f04b24aa66a09279a4318b', 'request_id': 'req-573189c1-62d2-4949-b440-096eceb86774'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.906095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68cb09a2b8f04b24aa66a09279a4318b', 'request_id': 'req-573189c1-62d2-4949-b440-096eceb86774'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.918299 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] The token cache is being invalidate because project 68cb09a2b8f04b24aa66a09279a4318b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:59:09.918592 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.919211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:09.920840 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1404/2826] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:59:09 2022] DELETE /identity/v3/projects/68cb09a2b8f04b24aa66a09279a4318b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:09.924828 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:09.934740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765a5c2-ba3a-4109-882b-64ee120cc405 service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:09.990663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:09.991911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:09.992420 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:09.992702 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] PATH_INFO: `/v3/users/ca4163e5758440babc57f93495f61fc6` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:09.993982 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4163e5758440babc57f93495f61fc6)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:09.995957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:10.010043 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:10.176783 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4163e5758440babc57f93495f61fc6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:10.177356 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4163e5758440babc57f93495f61fc6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:10.242959 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4163e5758440babc57f93495f61fc6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:10.243671 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4163e5758440babc57f93495f61fc6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:10.251210 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-e3d6c81a-0329-41b1-b635-8573bdca06fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4163e5758440babc57f93495f61fc6'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:10.269027 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1423/2827] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:59:09 2022] DELETE /identity/v3/users/ca4163e5758440babc57f93495f61fc6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:10.725143 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:10.727175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:10.740664 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573189c1-62d2-4949-b440-096eceb86774 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:10.798574 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:10.799440 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:10.799722 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:10.799995 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] PATH_INFO: `/v3/projects/7498349ad6104cc480e6036edc1c26d8` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:10.801231 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7498349ad6104cc480e6036edc1c26d8)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:10.803132 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:10.914671 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:10.918293 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7498349ad6104cc480e6036edc1c26d8', 'request_id': 'req-9c872aa7-a0eb-4172-83fc-93ef7cac3687'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:10.924280 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7498349ad6104cc480e6036edc1c26d8', 'request_id': 'req-9c872aa7-a0eb-4172-83fc-93ef7cac3687'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:11.019848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7498349ad6104cc480e6036edc1c26d8', 'request_id': 'req-9c872aa7-a0eb-4172-83fc-93ef7cac3687'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:11.030358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] The token cache is being invalidate because project 7498349ad6104cc480e6036edc1c26d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:59:11.030893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:11.032028 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-9c872aa7-a0eb-4172-83fc-93ef7cac3687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:11.033758 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1405/2828] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:59:10 2022] DELETE /identity/v3/projects/7498349ad6104cc480e6036edc1c26d8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:11.039230 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.039890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.039890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.058486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:11.059803 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:11.122103 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1424/2829] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:59:11.129890 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.130183 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.130469 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.282740 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:11.283881 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:11.292557 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1406/2830] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:11.296834 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.306698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7377-f817-4487-a7bd-25a7b0807c0a None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:11.311343 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:11.311999 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.312325 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.312606 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] PATH_INFO: `/v3/domains` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.313329 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:59:11.313637 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:11.315231 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:11.326679 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1425/2831] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:59:11.330911 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.340794 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa37af-6fe5-49db-bda3-6a94a4bd66c6 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:11.345482 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:11.346129 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.346409 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.346681 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.347382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:11.349548 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:11.472523 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1407/2832] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:59:11 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:59:11.477520 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.487645 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166024f-7da8-4779-9bb2-ad7ec6a3025d admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:11.543875 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:11.544514 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.544835 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.545094 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.545811 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:11.547716 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:11.632196 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1426/2833] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:59:11 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:59:11.636434 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.646556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7cfca-2e8a-4084-a2db-6016552f3042 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:11.651768 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:11.652451 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.652738 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.653014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.653733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:11.655296 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:11.665521 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1408/2834] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:11.669349 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.679561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9622e75-338e-441b-9ee7-ac320d99addc admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:11.684268 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435d54-0b5d-4912-8141-5fd03ee6c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:11.684920 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435d54-0b5d-4912-8141-5fd03ee6c9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.685203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435d54-0b5d-4912-8141-5fd03ee6c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.685479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435d54-0b5d-4912-8141-5fd03ee6c9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.686195 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78435d54-0b5d-4912-8141-5fd03ee6c9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:11.687781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78435d54-0b5d-4912-8141-5fd03ee6c9b0 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:11.689810 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:11.699184 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1427/2835] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:11.706020 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.716457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1049-2b36-4358-b06c-0a284791f90d admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:11.721055 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:11.721918 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.722197 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.722467 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] PATH_INFO: `/v3/projects/b2ba93f28ab34253903b52621b23cb19/users/b6832ef66d864584943fd1435c3dcc27/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.737433 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ba93f28ab34253903b52621b23cb19, user_id=b6832ef66d864584943fd1435c3dcc27, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:11.743065 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:11.854530 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1409/2836] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:11 2022] PUT /identity/v3/projects/b2ba93f28ab34253903b52621b23cb19/users/b6832ef66d864584943fd1435c3dcc27/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 13:59:11.866276 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2ba7-1a17-462e-bbfa-654a1a933be4 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:11.866571 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2ba7-1a17-462e-bbfa-654a1a933be4 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:11.866860 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2ba7-1a17-462e-bbfa-654a1a933be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:11.893894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-dcaa2ba7-1a17-462e-bbfa-654a1a933be4 None None] MFA Rules not processed for user `b6832ef66d864584943fd1435c3dcc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:11.895112 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-dcaa2ba7-1a17-462e-bbfa-654a1a933be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:11.959653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1428/2837] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:11.970500 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:11.972187 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:12.034029 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d55c4f-2c82-4a4c-b20d-e7bef3171af0 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:12.037789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:12.038757 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:12.039047 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:12.039324 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:12.047894 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:12.049334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:12.058627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1410/2838] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:14.042824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:14.043315 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:14.043528 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:14.061653 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] MFA Rules not processed for user `b6832ef66d864584943fd1435c3dcc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:14.063046 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:14.070159 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1429/2839] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:14.671495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:14.673134 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:14.764616 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b61da5-208d-47e3-be14-a037e5495653 service cinder] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:14.769603 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:14.770255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:14.770539 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:14.770818 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:14.772628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:14.787830 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:14.791824 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d376f-c5a0-4abc-9c38-34225f4144a6 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:14.801585 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:14.807182 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1411/2840] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:24.055616 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=36 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:24.235158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:24.236621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:24.318498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddf3f2-cc89-4589-8930-0e581f6f472b None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:24.324782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:24.325436 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:24.325722 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:24.326001 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:24.327787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:24.341253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:24.342867 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:24.354531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1430/2841] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:30.680713 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8e54-7727-48c3-8675-88b9c22c5a69 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:30.681209 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8e54-7727-48c3-8675-88b9c22c5a69 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:30.681316 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8e54-7727-48c3-8675-88b9c22c5a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:30.708802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-66cd8e54-7727-48c3-8675-88b9c22c5a69 None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:30.709971 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-66cd8e54-7727-48c3-8675-88b9c22c5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:30.764536 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1412/2842] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:59:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 13:59:30.921632 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:30.923050 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:30.991432 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6187f7-ec6c-4ef2-a355-d7c159302bce service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:30.996419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:30.997857 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:30.998145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:30.998422 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:31.006442 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:31.008045 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:31.016403 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1431/2843] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:59:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:59:31.902696 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74c46-3041-4d61-8552-88d9aa8cda0d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:31.903791 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74c46-3041-4d61-8552-88d9aa8cda0d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:31.903935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74c46-3041-4d61-8552-88d9aa8cda0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:31.921126 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-e8f74c46-3041-4d61-8552-88d9aa8cda0d None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:31.922340 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-e8f74c46-3041-4d61-8552-88d9aa8cda0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:31.930014 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1413/2844] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 8 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:31.942166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:31.953663 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ec0c-a62b-4388-888e-7b4f26450faf service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:31.958787 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:31.959467 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:31.959753 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:31.960030 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:31.969162 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:31.970791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:31.979203 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1432/2845] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:59:32.716074 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14d84b-d963-46cc-a776-1da409b32bca None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:32.716362 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14d84b-d963-46cc-a776-1da409b32bca None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:32.716636 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14d84b-d963-46cc-a776-1da409b32bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:32.735736 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-5b14d84b-d963-46cc-a776-1da409b32bca None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:32.736980 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-5b14d84b-d963-46cc-a776-1da409b32bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:32.744534 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1414/2846] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 8 13:59:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:32.756479 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:32.767979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b16e-4768-46c0-b65e-6b335df77bc4 service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:32.773484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:32.776084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:32.776084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:32.776084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:32.783223 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:32.784845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:32.792822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1433/2847] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:59:33.396782 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:33.397282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:33.397390 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:33.414682 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] MFA Rules not processed for user `19ce6d63072e4822aa4e4da5371d7090`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:33.415873 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:33.423502 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1415/2848] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 8 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:33.435865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:33.446548 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa38709-cc72-433a-91d0-a201458992f0 service swift] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:33.451766 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491100c8-116b-4bc8-b68f-852579a73c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d31e9b69d4807a3e31f796fca6274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:33.452426 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491100c8-116b-4bc8-b68f-852579a73c17 service swift] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:33.452712 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491100c8-116b-4bc8-b68f-852579a73c17 service swift] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:33.453072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491100c8-116b-4bc8-b68f-852579a73c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:33.461220 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491100c8-116b-4bc8-b68f-852579a73c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:33.462801 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491100c8-116b-4bc8-b68f-852579a73c17 service swift] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:33.471111 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1434/2849] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 8 13:59:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 13:59:36.424290 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:36.487932 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcca3ea-e0d7-445a-9cbd-c2bac24c909d None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:36.492596 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:36.493579 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:36.493970 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:36.494253 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] PATH_INFO: `/v3/users/b6832ef66d864584943fd1435c3dcc27` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:36.495479 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6832ef66d864584943fd1435c3dcc27)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:36.497410 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:36.696785 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6832ef66d864584943fd1435c3dcc27'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:36.756907 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6832ef66d864584943fd1435c3dcc27'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:36.757519 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6832ef66d864584943fd1435c3dcc27'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:36.758137 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6832ef66d864584943fd1435c3dcc27'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:36.765513 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6832ef66d864584943fd1435c3dcc27'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:36.776503 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:36.783631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1416/2850] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:59:36 2022] DELETE /identity/v3/users/b6832ef66d864584943fd1435c3dcc27 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:36.788164 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:36.788638 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:36.788776 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:36.806746 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:36.807958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:36.831917 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=100 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:36.869002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1435/2851] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:36.878960 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:36.880401 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:36.938899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101ef8-beb5-425c-9440-96c22da2a811 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:36.942628 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3946-4053-4e1b-84b1-9ee9f8a81dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:36.945777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3946-4053-4e1b-84b1-9ee9f8a81dee service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:36.945777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3946-4053-4e1b-84b1-9ee9f8a81dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:36.945777 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3946-4053-4e1b-84b1-9ee9f8a81dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:36.953593 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e3946-4053-4e1b-84b1-9ee9f8a81dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:36.954954 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e3946-4053-4e1b-84b1-9ee9f8a81dee service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:36.964520 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1417/2852] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:37.268126 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:37.269621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:37.284502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe143a-c2a1-4d26-940c-2de80525bac2 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:37.289347 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:37.290303 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:37.290580 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:37.290884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] PATH_INFO: `/v3/projects/b2ba93f28ab34253903b52621b23cb19` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:37.292149 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ba93f28ab34253903b52621b23cb19)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:37.294132 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:37.416512 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ba93f28ab34253903b52621b23cb19', 'request_id': 'req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:37.540324 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ba93f28ab34253903b52621b23cb19', 'request_id': 'req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:37.546340 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ba93f28ab34253903b52621b23cb19', 'request_id': 'req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:37.558031 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] The token cache is being invalidate because project b2ba93f28ab34253903b52621b23cb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:59:37.558336 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:37.559041 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-4d2eb65a-1644-417e-9c1a-64c4d5e3eb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:37.561301 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1436/2853] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:59:37 2022] DELETE /identity/v3/projects/b2ba93f28ab34253903b52621b23cb19 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:37.566305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:37.566804 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:37.566923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:37.584631 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:37.585803 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:37.645544 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1418/2854] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:37.654002 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:37.654285 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:37.654567 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:37.673519 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:37.674755 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:37.682714 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1437/2855] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:37.687822 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:37.697657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6595ba-c4d3-4313-8dc1-4f0dc921cb83 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:37.702333 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:37.702978 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:37.703255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:37.703546 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:37.704357 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:59:37.704661 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:37.706234 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:37.717866 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1419/2856] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:59:37.721995 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:37.731602 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ff3f1-6c3d-4f9e-845e-bc5fcc189e24 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:37.736931 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:37.737615 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:37.737900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:37.738201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:37.738899 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:37.740926 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:37.855530 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1438/2857] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:59:37 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:37.860004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:37.869893 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae37e7-bedc-4cdc-9b6c-538948477bb2 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:37.925899 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:37.926568 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:37.926854 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:37.927155 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:37.927876 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:37.929933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:38.025600 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1420/2858] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:59:37 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:38.029938 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:38.040864 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1912fc8-4bd3-4a24-bc81-329fcdad45c8 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:38.045563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:38.046865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:38.047147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:38.047423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:38.048183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:38.049786 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:38.061555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1439/2859] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:38.064419 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:38.074656 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b3839-6ebe-40e1-a0c8-68a8320170d0 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:38.079895 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94d98-aca3-41b4-886c-ff1fe3590fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:38.080597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94d98-aca3-41b4-886c-ff1fe3590fec admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:38.084834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94d98-aca3-41b4-886c-ff1fe3590fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:38.084834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94d98-aca3-41b4-886c-ff1fe3590fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:38.084834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94d98-aca3-41b4-886c-ff1fe3590fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:38.084834 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94d98-aca3-41b4-886c-ff1fe3590fec admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:38.097935 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1421/2860] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:38.099248 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:38.110395 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30165562-afd5-4645-805a-ec938250f507 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:38.114958 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:38.115836 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:38.116157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:38.116441 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] PATH_INFO: `/v3/projects/f186e80deb64431cbef6128e742f9aa4/users/3c2f0806fff247dd8f0cc8fba9fe53bd/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:38.131531 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f186e80deb64431cbef6128e742f9aa4, user_id=3c2f0806fff247dd8f0cc8fba9fe53bd, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:38.134194 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:38.266419 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1440/2861] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:38 2022] PUT /identity/v3/projects/f186e80deb64431cbef6128e742f9aa4/users/3c2f0806fff247dd8f0cc8fba9fe53bd/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:38.276902 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51971-11fc-4971-82d8-245148057573 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:38.277198 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51971-11fc-4971-82d8-245148057573 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:38.277481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51971-11fc-4971-82d8-245148057573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:38.285369 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:38.305081 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d4b51971-11fc-4971-82d8-245148057573 None None] MFA Rules not processed for user `3c2f0806fff247dd8f0cc8fba9fe53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:38.306287 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d4b51971-11fc-4971-82d8-245148057573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:38.371111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1422/2862] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:38.382412 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:38.384124 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:38.438649 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:38.462859 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af905-eaa2-45f9-90f0-e28b44e3aeef admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:38.466554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e186b-b83c-4c18-aa69-ba642b07529f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a04840b445544828154575b4ac4a241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:38.467201 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e186b-b83c-4c18-aa69-ba642b07529f service cinder] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:38.467485 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e186b-b83c-4c18-aa69-ba642b07529f service cinder] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:38.467760 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e186b-b83c-4c18-aa69-ba642b07529f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:38.476962 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e186b-b83c-4c18-aa69-ba642b07529f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:38.478400 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e186b-b83c-4c18-aa69-ba642b07529f service cinder] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:38.487535 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1441/2863] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:46.443832 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51971-11fc-4971-82d8-245148057573 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:46.505470 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51971-11fc-4971-82d8-245148057573 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:46.509924 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:46.510792 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:46.511073 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:46.511348 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] PATH_INFO: `/v3/users/3c2f0806fff247dd8f0cc8fba9fe53bd` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:46.512570 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2f0806fff247dd8f0cc8fba9fe53bd)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:46.514448 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:46.667706 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2f0806fff247dd8f0cc8fba9fe53bd'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:46.757036 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2f0806fff247dd8f0cc8fba9fe53bd'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:46.757601 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2f0806fff247dd8f0cc8fba9fe53bd'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:46.758210 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2f0806fff247dd8f0cc8fba9fe53bd'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:46.765276 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2f0806fff247dd8f0cc8fba9fe53bd'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:46.783327 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1423/2864] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 13:59:46 2022] DELETE /identity/v3/users/3c2f0806fff247dd8f0cc8fba9fe53bd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:46.788573 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:46.789074 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:46.789182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:46.806775 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:46.807951 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:46.867307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1442/2865] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:46.877538 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:46.878941 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:46.892913 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:46.935091 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8485f-1c9d-4c8c-93b7-5b68c0fb5af5 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:46.938655 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397046a-a286-47f0-89e7-9904a28321af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:46.939292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397046a-a286-47f0-89e7-9904a28321af service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:46.940101 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397046a-a286-47f0-89e7-9904a28321af service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:46.940368 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397046a-a286-47f0-89e7-9904a28321af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:46.949256 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397046a-a286-47f0-89e7-9904a28321af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:46.950658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397046a-a286-47f0-89e7-9904a28321af service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:46.961367 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1424/2866] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:47.421061 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:47.422484 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:47.435051 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8b63-bb8b-410a-89d0-1dd37b0a73a8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:47.440583 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:47.441439 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:47.441709 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:47.441979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] PATH_INFO: `/v3/projects/f186e80deb64431cbef6128e742f9aa4` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:47.443292 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f186e80deb64431cbef6128e742f9aa4)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:47.445261 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:47.545482 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f186e80deb64431cbef6128e742f9aa4', 'request_id': 'req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:47.602424 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f186e80deb64431cbef6128e742f9aa4', 'request_id': 'req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:47.608208 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f186e80deb64431cbef6128e742f9aa4', 'request_id': 'req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:47.619590 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] The token cache is being invalidate because project f186e80deb64431cbef6128e742f9aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 13:59:47.620298 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:47.620698 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-87379c94-1d7f-4d73-b407-39d7ebc6f7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 13:59:47.622371 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1443/2867] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 13:59:47 2022] DELETE /identity/v3/projects/f186e80deb64431cbef6128e742f9aa4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:47.627439 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:47.627940 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:47.628076 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:47.645003 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:47.646184 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:47.703949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1425/2868] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:47.711845 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:47.712173 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:47.712460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:47.731180 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:47.732394 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:47.740955 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1444/2869] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:47.744938 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:47.754325 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f6224-cdae-4b8f-9c73-ae23a0cfb231 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:47.758819 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:47.759492 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:47.759771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:47.760044 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:47.760786 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 13:59:47.761089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:47.762657 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:47.773801 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1426/2870] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 8 13:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 13:59:47.777782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:47.787555 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3953a-c11b-4753-bf87-417cdbb4a7f8 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:47.792318 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:47.792974 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:47.793254 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:47.793529 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:47.794213 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:47.796135 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:47.883678 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1445/2871] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:59:47 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:47.888096 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:47.898181 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd858-769d-42ac-93a7-522fe1ea3043 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:47.953545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:47.954255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:47.954481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:47.954753 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] PATH_INFO: `/v3/users` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:47.956153 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:47.958042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:48.043013 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1427/2872] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:59:47 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:59:48.046989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:48.058087 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326866d-56d6-4076-be88-44b299ce4703 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:48.062918 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:48.063627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:48.063980 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:48.064287 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] PATH_INFO: `/v3/roles` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:48.065662 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:48.067284 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:48.077869 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1446/2873] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:48.082061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:48.092516 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600b9b-eddc-4ad8-a27c-9b31640fc509 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:48.097550 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e971-74fb-4671-b342-501eb61972d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:48.097933 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e971-74fb-4671-b342-501eb61972d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:48.098218 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e971-74fb-4671-b342-501eb61972d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:48.098495 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e971-74fb-4671-b342-501eb61972d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:48.099222 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e971-74fb-4671-b342-501eb61972d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:48.101111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e971-74fb-4671-b342-501eb61972d5 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:48.111205 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1428/2874] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:48.115884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:48.125913 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11891d3d-6c75-4929-8971-d9052636becd admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:48.131551 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:48.132498 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:48.132785 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:48.133063 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] PATH_INFO: `/v3/projects/935e40a140d74e528002c0bcfd1515aa/users/fc41110d12a047f58219b4cf2619f80d/roles/b6aee05490564ee3847a4e359279b54f` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:48.145460 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:48.148610 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935e40a140d74e528002c0bcfd1515aa, user_id=fc41110d12a047f58219b4cf2619f80d, role_id=b6aee05490564ee3847a4e359279b54f)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:48.151256 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:48.283214 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1447/2875] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:48 2022] PUT /identity/v3/projects/935e40a140d74e528002c0bcfd1515aa/users/fc41110d12a047f58219b4cf2619f80d/roles/b6aee05490564ee3847a4e359279b54f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:48.288844 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:48.293634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:48.293634 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:48.308360 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] MFA Rules not processed for user `f3324493261445ea97cf7d9e4edb1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:48.309566 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:48.327004 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:48.370684 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1429/2876] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:48.380872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:48.382589 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:48.440327 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a8420-0fb1-4895-9cba-bf6b102b2372 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:48.443989 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1cef-0b3c-43d8-a137-4bc42361acec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:48.444656 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1cef-0b3c-43d8-a137-4bc42361acec service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:48.444935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1cef-0b3c-43d8-a137-4bc42361acec service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:48.445207 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1cef-0b3c-43d8-a137-4bc42361acec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:48.453957 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1cef-0b3c-43d8-a137-4bc42361acec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:48.455379 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1cef-0b3c-43d8-a137-4bc42361acec service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:48.464911 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1448/2877] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:50.417552 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:50.419535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:50.528426 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c749e5-1ede-4f2e-9118-1fb290e75760 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:50.533766 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:50.534981 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:50.535457 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:50.535903 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:50.537797 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:50.549763 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:50.551723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:50.562303 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1430/2878] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 13:59:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 13:59:54.154183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.154183 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.155166 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.186622 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] MFA Rules not processed for user `fc41110d12a047f58219b4cf2619f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 13:59:54.187872 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 13:59:54.270471 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1449/2879] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 13:59:54.273185 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:54.287988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc872df-d9e4-4c84-a456-a07317163618 service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:54.293341 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:54.294016 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.294305 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.294580 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.295282 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:54.297211 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:54.425294 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1431/2880] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 8 13:59:54 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 13:59:54.426853 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:54.441369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58fd09-2527-4005-9471-0ee0c6508c35 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:54.514333 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:54.515011 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.515291 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.515563 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] PATH_INFO: `/v3/users` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.516280 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:54.518253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:54.677532 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1450/2881] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 8 13:59:54 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 13:59:54.681676 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:54.692955 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316006-c153-4d53-9d30-719dc2227687 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:54.697572 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:54.698237 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.698526 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.698848 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.699632 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:54.701255 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:54.713338 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1432/2882] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:54.718658 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:54.729740 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70dab8-1816-43af-ab80-3cecf315a1de admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:54.734757 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:54.735660 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.735945 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.736262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] PATH_INFO: `/v3/projects/5dd437ec8c6649d7b2c1792ec76dff99/users/b52f4ce51fc14391af3c80ef5b0334c1/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.749630 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:54.754398 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd437ec8c6649d7b2c1792ec76dff99, user_id=b52f4ce51fc14391af3c80ef5b0334c1, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:54.757228 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:54.865781 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1451/2883] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:54 2022] PUT /identity/v3/projects/5dd437ec8c6649d7b2c1792ec76dff99/users/b52f4ce51fc14391af3c80ef5b0334c1/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 13:59:54.869952 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:54.880863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5687b-238d-474a-9d88-49d94cff9d2f admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:54.939370 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7cf21-7f6f-430e-a86e-69eeb6278c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:54.940261 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7cf21-7f6f-430e-a86e-69eeb6278c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.940576 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7cf21-7f6f-430e-a86e-69eeb6278c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.940883 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7cf21-7f6f-430e-a86e-69eeb6278c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.941698 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7cf21-7f6f-430e-a86e-69eeb6278c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:54.943431 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7cf21-7f6f-430e-a86e-69eeb6278c2a admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:54.944863 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:54.954283 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1433/2884] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 8 13:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 13:59:54.959464 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 13:59:54.970158 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eaa27-cb32-4fae-935c-c9d0cfd37d7b admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 13:59:54.975979 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 13:59:54.977141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 13:59:54.977499 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 13:59:54.977782 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] PATH_INFO: `/v3/projects/5dd437ec8c6649d7b2c1792ec76dff99/users/b52f4ce51fc14391af3c80ef5b0334c1/roles/06c074382d5e4a2893d59028af60fee8` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 13:59:54.980127 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd437ec8c6649d7b2c1792ec76dff99, user_id=b52f4ce51fc14391af3c80ef5b0334c1, role_id=06c074382d5e4a2893d59028af60fee8)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 13:59:54.982892 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 13:59:54.995668 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1452/2885] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 8 13:59:54 2022] PUT /identity/v3/projects/5dd437ec8c6649d7b2c1792ec76dff99/users/b52f4ce51fc14391af3c80ef5b0334c1/roles/06c074382d5e4a2893d59028af60fee8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 14:00:00.482258 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad6e6c-b9c6-4459-9f20-8dd6ca99dd98 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:00:00.483152 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad6e6c-b9c6-4459-9f20-8dd6ca99dd98 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:00:00.483438 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad6e6c-b9c6-4459-9f20-8dd6ca99dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:00:00.511026 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-30ad6e6c-b9c6-4459-9f20-8dd6ca99dd98 None None] MFA Rules not processed for user `b52f4ce51fc14391af3c80ef5b0334c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 14:00:00.512173 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-30ad6e6c-b9c6-4459-9f20-8dd6ca99dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:00:00.616923 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1434/2886] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 14:00:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 14:00:00.633553 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:00:00.635348 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:00:00.741308 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecbf18-9115-4baf-9a5a-2747fd375887 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:00:00.747178 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:00:00.747838 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:00:00.748153 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:00:00.748431 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:00:00.807621 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:00:00.809316 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:00:00.818894 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1453/2887] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:00:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:00:10.612810 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=36 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:10.814987 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:19.374545 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:00:19.375085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:00:19.375085 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:00:19.393230 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] MFA Rules not processed for user `fc41110d12a047f58219b4cf2619f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 14:00:19.394597 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:00:19.401354 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1435/2888] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 14:00:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 14:00:19.710355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:00:19.711826 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:00:19.770272 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4436b-0432-4d5d-99ee-1ae3dc37efa0 service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:00:19.774145 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:00:19.774795 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:00:19.775081 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:00:19.775360 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:00:19.777182 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:00:19.787262 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:00:19.788900 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:00:19.797097 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1454/2889] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:00:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:00:29.388089 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=3 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:29.793369 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=26 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:39.357189 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:00:39.366802 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227f35-a7fd-4524-b15b-2ca5f7d38487 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:00:39.370358 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:00:39.370989 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:00:39.371267 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:00:39.371535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:00:39.380609 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:00:39.384038 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:00:39.391886 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1436/2890] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:00:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 14:00:41.603542 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:00:41.618157 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eae74-3e6a-441b-aac7-7b6b9b4e054b service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:00:41.623822 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:00:41.624504 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:00:41.624789 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:00:41.625072 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:00:41.626832 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:00:41.640114 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:00:41.641871 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:00:41.653806 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1455/2891] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:00:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:00:49.387703 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=6 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:51.649253 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=6 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:36.261157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:02:36.271168 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795703c-d19e-4ef3-b4c5-d629d16d79b6 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:02:36.275042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:02:36.275733 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:02:36.276022 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:02:36.276331 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:02:36.278095 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:02:36.292584 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:02:36.293993 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dcda9-e426-4bc8-acaa-cad9da28e44a service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:02:36.304986 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1437/2892] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:02:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:02:37.482144 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:02:37.492693 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493bc0e-8b55-4f79-9efd-219a8bbfeb61 service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:02:37.496307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:02:37.496972 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:02:37.497258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:02:37.497537 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:02:37.499345 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:02:37.512971 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:02:37.514401 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:02:37.525759 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1456/2893] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:02:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:02:40.920292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] REQUEST_METHOD: `POST` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:02:40.920292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:02:40.920292 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:02:40.937070 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.auth.core [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] MFA Rules not processed for user `fc41110d12a047f58219b4cf2619f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 14:02:40.938274 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:02:40.946279 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1438/2894] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 14:02:41.254797 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:02:41.263417 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e4db-23a4-4640-8edf-0f147660df6d service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:02:41.267151 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:02:41.267791 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:02:41.268101 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:02:41.268384 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:02:41.270129 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:02:41.279502 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:02:41.280970 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e74d8-1909-4be7-a617-5dbe47f73d1e service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:02:41.289586 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1457/2895] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:02:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:02:44.662837 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:02:44.675673 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e7b3-73c9-4ecc-bae4-f7eb62ed89e1 None None] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:02:44.680496 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:02:44.681363 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:02:44.681988 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:02:44.682396 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:02:44.685015 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:02:44.697853 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:02:44.699273 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:02:44.711612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1439/2896] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:02:51.285884 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=12 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:54.707309 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=15 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:04:52.509358 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] REQUEST_METHOD: `POST` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:04:52.509922 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:04:52.510084 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:04:52.527988 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.auth.core [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] MFA Rules not processed for user `fc41110d12a047f58219b4cf2619f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 14:04:52.529258 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:04:52.536102 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1458/2897] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 8 14:04:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 14:04:53.653061 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:04:53.732846 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803287e3-461a-4df3-a672-c45bace17547 service neutron] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:04:53.739415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:04:53.739415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:04:53.739415 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:04:53.739795 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:04:53.741301 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:04:53.753927 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:04:53.755540 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:04:53.765769 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1440/2898] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:04:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:04:54.907906 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:04:54.909418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:04:54.924382 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6889027-3bc0-4eab-9bc5-fe7d1827f0c0 None None] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:04:54.929255 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:04:54.929889 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:04:54.930168 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:04:54.930438 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:04:54.938865 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:04:54.940472 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:04:54.950289 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1459/2899] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:04:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:04:57.670334 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:04:57.685871 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28eccd-1f74-4e85-8054-f51268750ca3 service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:04:57.691556 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:04:57.692111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:04:57.697487 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:04:57.697771 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:04:57.699723 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:04:57.712577 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:04:57.714157 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:04:57.726382 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1441/2900] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:04:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:05:01.594355 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:05:01.606991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f801614-1a5f-41ec-ac8a-697922b7c8ef service placement] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:05:01.612559 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:05:01.613198 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:05:01.613486 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:05:01.613767 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:05:01.621423 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:05:01.623919 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:05:01.632784 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1460/2901] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:05:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:05:07.721278 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=38 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:05:07.867042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:05:07.878627 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33a9f2-a64c-4106-b403-6097261bd04d service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:05:07.884386 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796757d15819413f8486471e778d95a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:05:07.885024 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:05:07.885308 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:05:07.885582 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:05:07.887391 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:05:07.900229 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:05:07.901817 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:05:07.913127 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1442/2902] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:05:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:05:11.628827 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=15 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:05:17.908481 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=6 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:06:56.020991 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:06:56.030937 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbfb79-96dc-412b-a6a9-c68be7c87f16 service nova] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:06:56.034554 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c3fd9ddab4118abf1729ac9a8f7c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:06:56.035188 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:06:56.035470 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:06:56.035747 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:06:56.096943 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:06:56.098396 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:06:56.108837 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1461/2903] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:06:59.369012 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:06:59.381999 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b126ea-354a-4c32-aa4a-a1ad139cf0a8 service nova] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:06:59.388206 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:06:59.388872 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] REQUEST_METHOD: `GET` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:06:59.389151 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:06:59.389427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:06:59.391307 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:06:59.403967 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:06:59.405595 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:06:59.416535 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1443/2904] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:07:03.305306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:07:03.316890 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287a1f-bbcb-42f7-8379-9a0886f4adbb service neutron] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:07:03.321639 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:07:03.322516 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:07:03.322796 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:07:03.323070 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] PATH_INFO: `/v3/users/fc41110d12a047f58219b4cf2619f80d` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:07:03.324306 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc41110d12a047f58219b4cf2619f80d)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:07:03.326249 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:07:03.490185 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc41110d12a047f58219b4cf2619f80d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:03.490842 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc41110d12a047f58219b4cf2619f80d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:03.572754 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc41110d12a047f58219b4cf2619f80d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:03.573418 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc41110d12a047f58219b4cf2619f80d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:03.580935 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc41110d12a047f58219b4cf2619f80d'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:03.599592 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1462/2905] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 14:07:03 2022] DELETE /identity/v3/users/fc41110d12a047f58219b4cf2619f80d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 14:07:03.850745 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:07:03.867326 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad85e-6935-46f8-a84d-fc1c6bcb7e5d service placement] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:07:03.920563 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:07:03.921427 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:07:03.921711 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:07:03.921990 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] PATH_INFO: `/v3/projects/935e40a140d74e528002c0bcfd1515aa` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:07:03.923175 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935e40a140d74e528002c0bcfd1515aa)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:07:03.925111 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:07:04.061789 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935e40a140d74e528002c0bcfd1515aa', 'request_id': 'req-c9397719-3ba9-4753-934d-c822d87611b7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.067793 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935e40a140d74e528002c0bcfd1515aa', 'request_id': 'req-c9397719-3ba9-4753-934d-c822d87611b7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.195949 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935e40a140d74e528002c0bcfd1515aa', 'request_id': 'req-c9397719-3ba9-4753-934d-c822d87611b7'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.208042 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] The token cache is being invalidate because project 935e40a140d74e528002c0bcfd1515aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 14:07:04.211658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.211658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.211658 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1444/2906] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 14:07:03 2022] DELETE /identity/v3/projects/935e40a140d74e528002c0bcfd1515aa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 14:07:04.214536 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:07:04.216075 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:07:04.229377 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152257d6-917a-4981-a6d8-8281d59be1be admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:07:04.290941 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:07:04.291831 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:07:04.292141 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:07:04.292421 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] PATH_INFO: `/v3/users/b52f4ce51fc14391af3c80ef5b0334c1` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:07:04.293705 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52f4ce51fc14391af3c80ef5b0334c1)` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:07:04.295635 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:07:04.302034 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:07:04.531664 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52f4ce51fc14391af3c80ef5b0334c1'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.532380 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52f4ce51fc14391af3c80ef5b0334c1'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.608956 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52f4ce51fc14391af3c80ef5b0334c1'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.609561 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52f4ce51fc14391af3c80ef5b0334c1'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.616707 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.notifications [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52f4ce51fc14391af3c80ef5b0334c1'} {{(pid=80578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:04.635172 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1463/2907] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 8 14:07:04 2022] DELETE /identity/v3/users/b52f4ce51fc14391af3c80ef5b0334c1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 14:07:04.884906 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Authenticating user token {{(pid=80579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:07:04.887207 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.fernet_utils [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:07:04.899667 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9397719-3ba9-4753-934d-c822d87611b7 admin admin] Validating token access rules against request {{(pid=80579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:07:04.957514 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3324493261445ea97cf7d9e4edb1c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c9b429555f24abe8bf7e676e75bbda4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:07:04.958379 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:07:04.958663 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:07:04.958939 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] PATH_INFO: `/v3/projects/5dd437ec8c6649d7b2c1792ec76dff99` {{(pid=80579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:07:04.960135 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd437ec8c6649d7b2c1792ec76dff99)` {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:07:04.962054 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] RBAC: Authorization granted {{(pid=80579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:07:04.984010 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:07:05.060687 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd437ec8c6649d7b2c1792ec76dff99', 'request_id': 'req-73386265-fd21-4a8f-8073-6ab7596e7f70'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:05.066735 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd437ec8c6649d7b2c1792ec76dff99', 'request_id': 'req-73386265-fd21-4a8f-8073-6ab7596e7f70'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:05.175113 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd437ec8c6649d7b2c1792ec76dff99', 'request_id': 'req-73386265-fd21-4a8f-8073-6ab7596e7f70'} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:05.186612 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] The token cache is being invalidate because project 5dd437ec8c6649d7b2c1792ec76dff99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 14:07:05.186905 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:05.187525 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG keystone.notifications [None req-73386265-fd21-4a8f-8073-6ab7596e7f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 14:07:05.189172 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: [pid: 80579|app: 0|req: 1445/2908] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 8 14:07:04 2022] DELETE /identity/v3/projects/5dd437ec8c6649d7b2c1792ec76dff99 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 14:07:14.631513 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:07:15.203742 dv-cinder-819149-5-iscsi devstack@keystone.service[80579]: DEBUG dbcounter [-] [80579] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:10:00.410824 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Authenticating user token {{(pid=80578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 14:10:00.412286 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:10:00.550113 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261673-a083-4e12-99c5-ba07a2bf0350 admin admin] Validating token access rules against request {{(pid=80578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 14:10:00.607627 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f97e4500d842ffb91180058af0cbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818e7e7f694d40c5aa48e4a883b3dc0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 14:10:00.608319 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] REQUEST_METHOD: `GET` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 14:10:00.608604 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] SCRIPT_NAME: `/identity` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 14:10:00.608879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 14:10:00.610629 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.fernet_utils [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 14:10:00.621734 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 14:10:00.623307 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed51860-5b96-4e62-baf8-33461504495b service placement] RBAC: Authorization granted {{(pid=80578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 14:10:00.633147 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: [pid: 80578|app: 0|req: 1464/2909] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 8 14:10:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 14:10:10.628879 dv-cinder-819149-5-iscsi devstack@keystone.service[80578]: DEBUG dbcounter [-] [80578] Writing DB stats keystone:SELECT=89 {{(pid=80578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}